GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 VL 32B Instruct
Qwen · ggml-org
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
CA
CantoneseLLM v2.0 8B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
QW
Qwen3.6 35B A3B REAP 48 v2
Qwen · crucible-labs
Params19.2B
Context256K
Smallest9.4 GB
Tool use
IN
Index Nailong 9B
Index · mradermacher
Params8.95B
Context224K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
VI
T VisStar 7B v0.1 i1
Visstar · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 27B Escha W2
Qwen · aj9o9
Params6.33B
Context256K
Smallest2.9 GB
GGUF
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
Roleplay
GE
Gemma 2B Uncensored
Gemma · lemuralabs
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
KI
Kiwen1.1 27B
Kiwen · NikiKrutan
Params27.3B
Context256K
Smallest8.9 GB
ReasoningVision
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · kepom
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
SA
vagosolutions_sauerkrautlm-7b-hero
Sauerkrautlm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
dnotitia_Smoothie Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
TM
Tmax v1.1 9b
Tmax · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
ED
vllm-d3-edge
Edge · ggml-org
Params748M
Context256K
Smallest0.8 GB
Vision
GU
Guanaco 13B Uncensored i1
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Logics SWE Qwen3.6 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
QW
Qwen3 14B
Qwen · lm-kit
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
DE
Decision 2.0 Vega 27B
Decision · vllm-sr
Params25.6B
Context32K
Q4_K_M15.9 GB
GGUF
QW
Qwen3 1.7B
Qwen · gaianet
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
JA
Jan-v3-4b-base-instruct
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
Coding
WE
WeVisOne VL 2B
Wevisone · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
Tool useVision
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
ReasoningTool use
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
CodingTool useVision
DP
openaccess-ai-collective_dpopenhermes-7b-v2
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing