GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
MI
MiMo V2 Flash
Mimo · mradermacher
Params309B
Context256K
Q4_K_M186.8 GB
FR
FrogNano 4B heretic
Frognano · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
SoliDeoGloria Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CH
Chinese Emotion
Chinese · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
DE
DeepSeek V4 Flash DSpark support
DeepSeek · sakamakismile
Params19.8B
Context—
Smallest6.0 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · Quantelium
Params8.95B
Context256K
Q4_K_M5.6 GB
ME
melotts en v2
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
WA
wavecoder-ultra-1.1-6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
GI
GigaChat3-10B-A1.8B
Gigachat · Mungert
Params10.7B
Context256K
Q4_K_M6.7 GB
DE
DeepSeek V4 Flash
DeepSeek · twaggs88
Params240B
Context1024K
Smallest92.5 GB
LL
scandukuri llama3 8b stargate m1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma SEA LION v4.5 E2B IT
Gemma · aisingapore
Params4.65B
Context128K
Q4_K_M3.4 GB
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
OM
OmniDimen 2.5 9B Emotion
Omnidimen · OmniDimen
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM 4.7 Flash Heretic
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
SP
Spark X2.5 4B Heretic
Spark · ItsOkayNow
Params4.11B
Context1024K
Q4_K_M2.6 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
BL
Q3.5 BlueStar v2 27B Uncensored Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 4b toolcall gguf llamacpp codex
Qwen · Manojb
Params4.02B
Context256K
Smallest4.3 GB
GL
GLM-5.3-Flash
GLM · neuralll
Params7.43B
Context1024K
Smallest4.6 GB
LU
Lumina-Next-135M
Lumina · jacopof
Params122M
Context8K
Smallest0.5 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
QW
Qwen3 8B NSFW JP
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
UnifiedReward Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GL
GLM 5.3 Flash
GLM · cafonez
Params321B
Context1024K
Smallest120.3 GB
GL
GLM 5.3 0.6B A0.4B
GLM · mradermacher
Params622M
Context1024K
Q4_K_M0.4 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GL
GLM 5.3 Flash UNCENSORED MTP Maya L
GLM · Adolphsson
Params564M
Context1024K
Smallest156.3 GB
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
UnifiedReward 2.0 Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB