GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningVision
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
qwen2.5-1.5b-instruct
Qwen · Qwen
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
B1
B1 9B
mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
TE
Tess 4 27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
ReasoningVision
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · prism-ml
Params2.5B
Context256K
Smallest1.6 GB
Vision
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GGUF
GE
gemma-4-26B-A4B-it
Gemma · ggml-org
Params450M
Context256K
Smallest0.3 GB
Vision
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
QW
qwen2.5-0.5b-instruct
Qwen · Qwen
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwythos-9B-v2
Qwythos · empero-ai
Params8.95B
Context1024K
Q4_K_M5.7 GB
ReasoningTool useVision
SP
Spark X2.5 4B
Spark · XHToken
Params4.1B
Context1024K
Q4_K_M2.6 GB
GGUF
WA
Wan2.2 Animate 14B
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
GGUF
IN
TML Inkling
Inkling · unsloth
Params950B
Context1024K
Smallest270.2 GB
ReasoningVision
QW
Qwythos 9B Claude Mythos 5 1M
Qwythos · empero-ai
Params8.95B
Context1024K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 14B Awq Compatible Instruct
Qwen · Qwen
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
SP
Spark X2.5 4B
Spark · abenzerps
Params4.1B
Context1024K
Q4_K_M2.6 GB
GGUF
GE
Gemmable 4 12B MTP
Gemma · Mia-AiLab
Params11.9B
Context256K
Q4_K_M0.3 GB
Reasoning
TE
Ternary Bonsai 8B
Ternary · prism-ml
Params8.19B
Context64K
Smallest2.2 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct GGUF
Qwen · Qwen
Params15B
Context128K
Q4_K_M9.4 GB
Coding
OR
Ornith 1.5 35B A3B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
JA
Jan-v3.5-4B
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
GGUF
HY
Hy MT2 1.8B
tencent
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.6 14B A3B FableVibes Hf
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB
CodingReasoningTool use

Keep browsing