GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
WE
WebGen LM 32B
Webgen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
GGUF
QW
PAPO G Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
NE
NextCoder Mirage Sol 7B
Nextcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
DO
Doctor-Chad
Doctor · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
Ultravox V0_6 Qwen 3 32b Arabic
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool useVision
KU
KURE v1
Kure · mykor
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
GL
GLM 5.3 Flash
GLM · rax4901
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
OP
OpenForecaster 8B
Openforecaster · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GL
GLM 4.5 Iceblink 106B A12B
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
GGUF
HO
Hormoz
Hormoz · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
TH
TheBeagle V2Beta 32B MGS
Thebeagle · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GL
GLM-4.5-Air-Derestricted
GLM · ddh0
Params110B
Context128K
Smallest68.6 GB
ReasoningTool use
CE
Cerebras OPT Fusion i1
Cerebras · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.5 9B py3.15
Ornith · satyrn-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
VP
VPPO 7B
Vppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
GE
Gemma SEA LION Guard v2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
MO
Moon Beam 16B A3B
Moon · tablinum
Params16B
Context8K
Smallest6.1 GB
GGUF
MI
mistral orpo beta
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
GGUF
CO
ConspLLM 7b
Conspllm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Co Rewarding I Qwen3 8B Base MATH
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
FR
FrogNano 4B Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningRoleplay
HU
Huihui Spark X2.5 4B abliterated
Huihui · okenk
Params4.1B
Context1024K
Q4_K_M2.6 GB
GGUF
MI
Mistral Nemo 12B RP
Mistral · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
NA
nanochat-40M
Nanochat · hudsongouge
Params40M
Context1K
Q4_K_M0.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use

Keep browsing