GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TimeCrystal l2 13B i1
Timecrystal · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
Roleplay
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
TE
NaviDC OCR
Teleocr · nandraj
Params752M
Context125K
Q4_K_M0.5 GB
Vision
QW
Qwen3.5 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
MO
MolOptAgent 7B
Moloptagent · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
MI
Mistral Small 4 119B Uncensored
Mistral · timteh673
Params119B
Context1024K
Q4_K_M72.2 GB
GGUF
GL
GLM 4.7 Flash Claude Opus 4.5 High Reasoning Distill
GLM · TeichAI
Params30B
Context198K
Q4_K_M18.1 GB
Reasoning
GR
Granite 20b Code Base R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
WI
models--microsoft--WizardLM-2-8x22B
Wizardlm · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context128K
Q4_K_M1.0 GB
Coding
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
CodingVision
WI
Wicked Stuff 12B
Wicked · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
RoleplayTool use
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Kataguru Qwen3.8 27B Titan v3.2
Qwen · kataguru
Params26.9B
Context256K
Smallest11.2 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MU
Muse-Glimmer-30B-Hermes-Agentic
Muse · vcruz305
Params27.9B
Context128K
Q4_K_M16.9 GB
Tool useVision
FL
flint
Flint · terelabs
Params39.8B
Context256K
Q4_K_M25.0 GB
ReasoningTool use
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M17.4 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool use
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
ReasoningTool useVision
QW
Qwen3.8 27B Uncensored
Qwen · jaromer
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
CL
Clef-Flash
Clef · turintech
Params9.08B
Context256K
Smallest3.6 GB
ReasoningTool use
AU
AuraFlow v0.3
Auraflow · city96
Params6.86B
Context—
Q4_K_M4.0 GB
GGUF
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context256K
Smallest32.5 GB
Coding
SM
SmolLM2 1.7B Instruct
SmolLM · lmstudio-community
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF

Keep browsing