GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KR
KREA 2 GGUFs
Krea · realrebelai
Params12.9B
Context—
Q4_K_M7.2 GB
GGUF
AU
Audio Flamingo
Audio · audio-cpp
Params—
Context—
Smallest5.5 GB
GGUF
QW
Qwen2.5 Omni 7B
Qwen · ggml-org
Params7.6B
Context32K
Q4_K_M4.7 GB
Vision
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GGUF
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
GGUF
QW
Huihui Qwen3.8 Flash Next abliterated i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
FL
Flux2 Klein 9B True V2
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
GGUF
NE
.nemotron-speech-streaming-en-0.6b.q8_0.gguf
Nemotron · nvidia
Params628M
Context—
Smallest0.7 GB
GGUF
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
GGUF
FL
FLUX.1 Fill dev
Flux · YarvixPA
Params11.9B
Context—
Smallest5.2 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · LiquidAI
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M119.6 GB
Vision
QW
Swift 1.5 Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params28B
Context256K
Smallest8.8 GB
Vision
YO
yovoice model
Yovoice · leemysw
Params—
Context—
Smallest0.3 GB
GGUF
KR
Krea 2 Turbo
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
Coding
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
GGUF
MI
MiniMax H3
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
GGUF
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
GGUF
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
Vision
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF

Keep browsing