GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
QW
qwen2.5-1.5b-instruct
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
B1
B1 9B
mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
TE
Tess 4 27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · prism-ml
Params2.5B
Context256K
Smallest1.6 GB
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GE
gemma-4-26B-A4B-it
Gemma · ggml-org
Params450M
Context256K
Smallest0.3 GB
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
QW
qwen2.5-0.5b-instruct
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
QW
Qwythos-9B-v2
Qwythos · empero-ai
Params8.95B
Context1024K
Q4_K_M5.7 GB
SP
Spark X2.5 4B
Spark · XHToken
Params4.1B
Context1024K
Q4_K_M2.6 GB
WA
Wan2.2 Animate 14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.5 GB
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
IN
TML Inkling
Inkling · unsloth
Params950B
Context1024K
Smallest270.2 GB
QW
Qwythos 9B Claude Mythos 5 1M
Qwythos · empero-ai
Params8.95B
Context1024K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
SP
Spark X2.5 4B
Spark · abenzerps
Params4.1B
Context1024K
Q4_K_M2.6 GB
GE
Gemmable 4 12B MTP
Gemma · Mia-AiLab
Params11.9B
Context256K
Q4_K_M0.3 GB
TE
Ternary Bonsai 8B
Ternary · prism-ml
Params8.19B
Context64K
Smallest2.2 GB
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · Qwen
Params15B
Context128K
Q4_K_M9.4 GB
OR
Ornith 1.5 35B A3B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
JA
Jan-v3.5-4B
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
HY
Hy MT2 1.8B
tencent
Params1.79B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.6 14B A3B FableVibes Hf
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB