GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 1.7B Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
BO
Boundary 4x7b MoE i1
Boundary · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
RW
rwkv7 g1h 1.5b i1
Rwkv · RemySkye
Params1.53B
Context1024K
Q4_K_M1.1 GB
QW
Qwen3.5 9B Harmonic
Qwen · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 35B A3B
Qwen · Advantech-EIOT
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
K2 Horizon 3.7B Heretic
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
QW
Qwen3.8 27B GSQ RCO IQ3 S recovered
Qwen · Joakimpalm-Zen
Params26.9B
Context256K
Smallest3.2 GB
HO
K2 Horizon 7B Candor Uncensored
Horizon · candor-lab
Params9B
Context512K
Q4_K_M5.6 GB
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CO
confucius4 tts
Confucius · cstr
Params112M
Context—
Smallest0.1 GB
GE
Gemma 4 26B A4B It SOMPOA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwythos 9B v2
Qwythos · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
QW
PopiT Qwen3 4B Medical SFT 1128
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
NE
NeoHorse 1 9 Uncensored
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DA
Dark Scarlett 27B v3.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M23.5 GB
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen Qwen3.6 35B A3B
Qwen · batiai
Params34.7B
Context256K
Q4_K_M21.2 GB
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GE
Gemma 4 12B It Heretic_Decensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GL
Huihui GLM 4.6V Flash abliterated
GLM · AliBilge
Params9.4B
Context128K
Q4_K_M6.2 GB
GE
gemma 4 E2B it UD japanese imatrix
Gemma · dahara1
Params4.65B
Context128K
Q4_K_M3.1 GB
MI
MiniCPM V 4.7 1B Heretic
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB