GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi 6B Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 12B EsperGrug
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Reasoning
QW
shisa v2.1 qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Ingot 27B DFlash2
Qwen · dendriteholdings
Params1.92B
Context256K
Smallest2.1 GB
ReasoningTool use
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
PH
Phi 3.5 Mini instruct_Uncensored
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · ggml-org
Params4B
Context256K
Smallest4.3 GB
GGUF
BA
Bamba 9B
Bamba · ibm-ai-platform
Params9.78B
Context—
Smallest19.6 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
WI
Wicked Stuff 12B
Wicked · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
FL
Flint
Flint · AtomicChat
Params39.8B
Context256K
Smallest13.3 GB
CodingReasoningTool use
LL
Llama 3.2 4X3B MOE Hell California Uncensored 10B
Llama · DavidAU
Params9.95B
Context128K
Q4_K_M6.1 GB
Roleplay
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
ReasoningVision
MY
Mythos 9b Unhinged
Mythos · King3Djbl
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
CodingVision
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
EmbeddingVision
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
Coding
PA
PaddleOCR VL manga
Paddleocr · LunarOilRig
Params467M
Context128K
Q4_K_M0.3 GB
Vision
MI
Mistral Nemo Instruct 2407
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TE
Bonsai-27B
Ternary · Hikari07jp
Params27B
Context256K
Smallest7.2 GB
GGUF
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.7 GB
ReasoningVision
QW
Qwen3 Swallow 8B RL v0.2
Qwen · mmnga-o
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF

Keep browsing