GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · zugquants
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
AI
jondurbin_airoboros-m-7b-3.1.2
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
ME
Med Advisor Conversation 4B
Med · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GP
GPT OSS Swallow 120B RL v0.1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
CodingTool use
GE
Gemma 4 Queen 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Security SLM Gemma 4 E2B it
Gemma · entrick
Params4.65B
Context128K
Q4_K_M3.4 GB
Tool use
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
MO
moss soundeffect
Moss · ilintar
Params1.49B
Context—
Smallest3.0 GB
GGUF
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
MI
Ministral 3 8B Nymphaea RP
Mistral · 0xA50C1A1
Params8.49B
Context—
Smallest0.0 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
GGUF
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
MI
Mia v2 29B
Mia · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
EU
Eurus 70b nca fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
TE
Tenebra_30B_Alpha01_FP16
Tenebra · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
GGUF
QW
Qwen3 8B Heretic GGUF
Qwen · xFanexx
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
FL
flint 40B A2.5B Q4 K M
Flint · Abiray
Params39.8B
Context256K
Q4_K_M24.1 GB
ReasoningTool use
GE
Gemma 4 12B
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
OC
Occamy 1.0 APEX I NanoPlus
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
BE
BetterWright K2 Horizon 7B Uno
Betterwright · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
Tool use

Keep browsing