GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
SE
Seed Coder 8B Instruct
Seed · second-state
Params8.25B
Context32K
Q4_K_M5.1 GB
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
GL
GLM 5.3 Flash
GLM · muterornament
Params321B
Context1024K
Smallest93.1 GB
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
SP
SP3F 7B
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
SvS Qwen Code 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MU
multilingual e5 base Q4 K M
Multilingual · dinab
Params277M
Context512
Q4_K_M0.2 GB
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
GLM 4.7 Flash abliterated 12GB
GLM · cognitivers
Params29.9B
Context198K
Smallest0.1 GB
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
GL
GLM4 32B Neon v2
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
ON
Oneirogen 7B Abominable Heresy
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Cybersecurity BaronLLM Offensive Security LLM Q6 K
Llama · AlicanKiraz0
Params8.03B
Context128K
Smallest6.6 GB
DE
DeepSeek V4 Flash Vision Exp Abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
CH
chatterbox nano
Chatterbox · cstr
Params180M
Context—
Smallest0.3 GB
GE
Survival Uncensored Gemma 270m v2
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
OR
Ornith 1.0 9B Abliterated Fable
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GL
GLM 5.3 Flash
GLM · Dgvdhb
Params321B
Context1024K
Smallest93.1 GB
KO
Kosolra Kullm LDCC Merge
Kosolra · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mmnga
Params14.8B
Context128K
Q4_K_M9.0 GB
TI
Tini1.5-8B-A1B
Tini · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
LI
lion 7b i1
Lion · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · Sci-fi-vy
Params8.19B
Context128K
Q4_K_M5.0 GB
GL
GLM-5.3-Flash
GLM · vultr
Params313B
Context1024K
Q4_K_M208.2 GB
BE
BEPA 7B S2
Bepa · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ME
MedAssistant 8B
Medassistant · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB