GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
Reasoning
TE
Ternary Bonsai 2 27B Abliterated PTQ1 0 MTP Q4 0
Ternary · Cheurteen
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
SP
Spark X2.5 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
GGUF
SE
Semancer 12B
Semancer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Qwen3.5 9B Claude Code
Qwen · empero-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
Coding
MI
Young Children Storyteller Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
QW
Qwen3.8 2B Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
GE
godot gemma 4 e4b it
Gemma · bekoozkan
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingVision
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool useVision
QW
knaif
Qwen · blackdeep
Params1.72B
Context40K
Q4_K_M2.5 GB
Tool use
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LO
Loopl 2b
Loopl · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
Tool useVision
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
MI
akjindal53244_arithmo-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
QW
Qwen3.5 9B Kimi K3 Distilled
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Reasoning
JA
Jais-3-3.7B
Jais · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
Reasoning
GE
Orthia-31B
Gemma · Nimbz
Params32B
Context256K
Q4_K_M19.8 GB
Roleplay
QW
Qwen2.5 Coder 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
OP
openbuddy-yi1.5-34b-v21.2-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SM
SmolLM 135M
SmolLM · HuggingFaceTB
Params135M
Context2K
Smallest0.1 GB
Tool use
QW
Qwen3.8 27B
Qwen · SoAIHQ
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
LO
Loopl 4b
Loopl · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Tool useVision
IN
InternVL3 8B Instruct
Internvl · ggml-org
Params7.61B
Context32K
Q4_K_M4.7 GB
Vision
TO
ToriiGate v0.4 7B
Toriigate · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision

Keep browsing