GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
qwen3 tts 1.7b customvoice
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
GGUF
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · llmfan46
Params79.7B
Context256K
Q4_K_M49.8 GB
Coding
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
GGUF
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
ReasoningTool useVision
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
SE
SenseNova 6.8 Code2Video GSQ RCO
Sensenova · OliviaRossi
Params26.9B
Context256K
Smallest10.2 GB
Vision
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GGUF
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
ReasoningTool use
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Reasoning
QW
Qwen3.8 27B EfficientThink VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
CodingReasoningVision
QW
Qwen3.8-27B
Qwen · jrell
Params27.3B
Context256K
Smallest13.5 GB
GGUF
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
WI
Wicked Stuff 26B A4B v2.1 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
HO
K2 Horizon 7B Heretic
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 30B A3B
Qwen · lmstudio-community
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
MI
teknium_openhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision

Keep browsing