GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 VL 32B Instruct
Qwen · ggml-org
Params32.8B
Context125K
Q4_K_M19.9 GB
CA
CantoneseLLM v2.0 8B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.6 35B A3B REAP 48 v2
Qwen · crucible-labs
Params19.2B
Context256K
Smallest9.4 GB
IN
Index Nailong 9B
Index · mradermacher
Params8.95B
Context224K
Q4_K_M5.6 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
VI
T VisStar 7B v0.1 i1
Visstar · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 27B Escha W2
Qwen · aj9o9
Params6.33B
Context256K
Smallest2.9 GB
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GE
Gemma 2B Uncensored
Gemma · lemuralabs
Params2.51B
Context8K
Q4_K_M1.6 GB
KI
Kiwen1.1 27B
Kiwen · NikiKrutan
Params27.3B
Context256K
Smallest8.9 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · kepom
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
SA
vagosolutions_sauerkrautlm-7b-hero
Sauerkrautlm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
dnotitia_Smoothie Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
TM
Tmax v1.1 9b
Tmax · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ED
vllm-d3-edge
Edge · ggml-org
Params748M
Context256K
Smallest0.8 GB
GU
Guanaco 13B Uncensored i1
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Logics SWE Qwen3.6 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 14B
Qwen · lm-kit
Params14.8B
Context40K
Q4_K_M9.0 GB
DE
Decision 2.0 Vega 27B
Decision · vllm-sr
Params25.6B
Context32K
Q4_K_M15.9 GB
QW
Qwen3 1.7B
Qwen · gaianet
Params2.03B
Context40K
Q4_K_M1.3 GB
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
JA
Jan-v3-4b-base-instruct
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
WE
WeVisOne VL 2B
Wevisone · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
DP
openaccess-ai-collective_dpopenhermes-7b-v2
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB