GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
YI
Yi 6B Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8 27B Heretic
Qwen · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12B EsperGrug
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
shisa v2.1 qwen3 8b
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
QW
Ingot 27B DFlash2
Qwen · dendriteholdings
Params1.92B
Context256K
Smallest2.1 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Max Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB
QW
Qwen3 4B Instruct 2507
Qwen · ggml-org
Params4B
Context256K
Smallest4.3 GB
BA
Bamba 9B
Bamba · ibm-ai-platform
Params9.78B
Context—
Smallest19.6 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
WI
Wicked Stuff 12B
Wicked · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
FL
Flint
Flint · AtomicChat
Params39.8B
Context256K
Smallest13.3 GB
LL
Llama 3.2 4X3B MOE Hell California Uncensored 10B
Llama · DavidAU
Params9.95B
Context128K
Q4_K_M6.1 GB
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
MY
Mythos 9b Unhinged
Mythos · King3Djbl
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
PA
PaddleOCR VL manga
Paddleocr · LunarOilRig
Params467M
Context128K
Q4_K_M0.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
TE
Bonsai-27B
Ternary · Hikari07jp
Params27B
Context256K
Smallest7.2 GB
QW
Qwen3.5 9B Gemini 3.1 Pro Reasoning Distill
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3 Swallow 8B RL v0.2
Qwen · mmnga-o
Params8.19B
Context40K
Q4_K_M5.0 GB