GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
WE
WebGen LM 32B
Webgen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
QW
PAPO G Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
NE
NextCoder Mirage Sol 7B
Nextcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DO
Doctor-Chad
Doctor · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
QW
Ultravox V0_6 Qwen 3 32b Arabic
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
KU
KURE v1
Kure · mykor
Params567M
Context8K
Q4_K_M0.4 GB
GL
GLM 5.3 Flash
GLM · rax4901
Params321B
Context1024K
Smallest93.1 GB
OP
OpenForecaster 8B
Openforecaster · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
GLM 4.5 Iceblink 106B A12B
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
HO
Hormoz
Hormoz · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
TH
TheBeagle V2Beta 32B MGS
Thebeagle · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GL
GLM-4.5-Air-Derestricted
GLM · ddh0
Params110B
Context128K
Smallest68.6 GB
CE
Cerebras OPT Fusion i1
Cerebras · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
OR
Ornith 1.5 9B py3.15
Ornith · satyrn-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
VP
VPPO 7B
Vppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma SEA LION Guard v2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MO
Moon Beam 16B A3B
Moon · tablinum
Params16B
Context8K
Smallest6.1 GB
MI
mistral orpo beta
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
CO
ConspLLM 7b
Conspllm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Co Rewarding I Qwen3 8B Base MATH
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
FR
FrogNano 4B Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HU
Huihui Spark X2.5 4B abliterated
Huihui · okenk
Params4.1B
Context1024K
Q4_K_M2.6 GB
MI
Mistral Nemo 12B RP
Mistral · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
NA
nanochat-40M
Nanochat · hudsongouge
Params40M
Context1K
Q4_K_M0.0 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB