GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Huihui Qwen3 4B Abliterated v2
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · lmstudio-community
Params7.62B
Context986K
Q4_K_M4.7 GB
QW
qwen3.8 27b abliterated 3.69bpw 12GB MTP
Qwen · soyaakinohara
Params27.3B
Context256K
Smallest12.6 GB
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
OM
Omega Arsenal 12B
Omega · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
MiniCPM-V-4.7-1B
MiniCPM · AtomicChat
Params1.01B
Context256K
Q4_K_M0.7 GB
MI
ehartford_dolphin-2.5-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
WH
Whisper Medium (English)
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
QW
Qwen2.5 VL 7B Instruct Unredacted MAX
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
OC
Occamy 1.0 Abliterated
Occamy · SC117
Params34.7B
Context256K
Q4_K_M16.5 GB
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
TE
Ternary Bonsai 2 27B 262k
Ternary · CaryPalmer
Params27.3B
Context256K
Smallest6.4 GB
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwopus3.6 27B Coder MTP
Qwopus · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · petruhonk
Params9.2B
Context256K
Smallest9.8 GB
OM
OmniCoder 9B
Omnicoder · Tesslate
Params8.95B
Context256K
Q4_K_M5.7 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Qwen3.8 4B Distill Heretic Abliterated
Qwen · yachen4ever
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
ME
Melody1437 26B A4B v2.0
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GR
Granite Speech 4.1 2B Plus
Granite · handy-computer
Params2.11B
Context—
Q4_K_M1.5 GB
LY
Lythri 4B A2B
Lythri · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
XI
Xiaomi OCR 0
Xiaomi · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB