GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
ZE
Zeta 2.1
Zeta · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
BR
Breeze-13B-32k-Instruct-v1_0
Breeze · mradermacher
Params12.7B
Context32K
Q4_K_M7.7 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · CrucibleLab
Params30.7B
Context256K
Q4_K_M18.7 GB
EC
EchoVLM_v2
Echovlm · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
IM
Z Image Turbo
Image · tsqn
Params6.15B
Context—
Q4_K_M5.0 GB
PP
pplx decider 27B Artemis
Pplx · turintech
Params26.9B
Context256K
Smallest14.3 GB
QW
GPT neo Custom 7B
Qwen · Szymon-Wachelko
Params7.6B
Context32K
Q4_K_M4.7 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
QW
Qwen3.6 27B
Qwen · froggeric
Params461M
Context256K
Q4_K_M16.8 GB
ER
ERNIE 4.5 21B A3B PT
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · EZForever
Params30.7B
Context256K
Smallest17.3 GB
SY
migtissera_synthia-7b-v1.3
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma 4 E4B it heretic
Gemma · igorls
Params7.5B
Context128K
Q4_K_M5.3 GB
FA
MN 12B Faun RP RU
Faun · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 24B Instruct 2506 ultra uncensored heretic
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · FrosT-LyRo
Params39.1B
Context256K
Q4_K_M23.9 GB
QW
Qwen3-Vl-2B-Thinking-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
QW
Qwen3.8 9B Function Calling xLAM Unsloth
Qwen · ermiaazarkhalili
Params9.2B
Context256K
Q4_K_M5.8 GB
TH
Thaki ASR KO Dialects v1 i1
Thaki · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
NO
nomic ai nomic embed code
Nomic · bartowski
Params7.1B
Context32K
Q4_K_M4.4 GB
AM
AmberChat
Amberchat · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
EK
Ekbasis Skopos 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Huihui MiniCPM V 4 5 abliterated
MiniCPM · huihui-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
AI
aiXcompact 4B
Aixcompact · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Llama 2 70B OASST 1 200
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LU
luxia 21.4b alignment v1.0
Luxia · MaziyarPanahi
Params21.4B
Context32K
Q4_K_M12.9 GB
KA
karakuri-lm-8x7b-instruct-v0.1
Karakuri · mmnga
Params46.7B
Context32K
Q4_K_M28.4 GB