GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo V2 Flash
Mimo · mradermacher
Params309B
Context256K
Q4_K_M186.8 GB
ReasoningTool use
FR
FrogNano 4B heretic
Frognano · saidutta69
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningRoleplay
GE
SoliDeoGloria Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
CH
Chinese Emotion
Chinese · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
GGUF
DE
DeepSeek V4 Flash DSpark support
DeepSeek · sakamakismile
Params19.8B
Context—
Smallest6.0 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · Quantelium
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
ME
melotts en v2
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
GGUF
WA
wavecoder-ultra-1.1-6.7b
Wavecoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GI
GigaChat3-10B-A1.8B
Gigachat · Mungert
Params10.7B
Context256K
Q4_K_M6.7 GB
Tool use
DE
DeepSeek V4 Flash
DeepSeek · twaggs88
Params240B
Context1024K
Smallest92.5 GB
ReasoningTool use
LL
scandukuri llama3 8b stargate m1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma SEA LION v4.5 E2B IT
Gemma · aisingapore
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF
OM
OmniDimen 2.5 9B Emotion
Omnidimen · OmniDimen
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GL
GLM 4.7 Flash Heretic
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
SP
Spark X2.5 4B Heretic
Spark · ItsOkayNow
Params4.11B
Context1024K
Q4_K_M2.6 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingTool useVision
BL
Q3.5 BlueStar v2 27B Uncensored Heretic
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
QW
Qwen3 4b toolcall gguf llamacpp codex
Qwen · Manojb
Params4.02B
Context256K
Smallest4.3 GB
CodingTool use
GL
GLM-5.3-Flash
GLM · neuralll
Params7.43B
Context1024K
Smallest4.6 GB
ReasoningTool use
LU
Lumina-Next-135M
Lumina · jacopof
Params122M
Context8K
Smallest0.5 GB
GGUF
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
QW
Qwen3 8B NSFW JP
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
UnifiedReward Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
GL
GLM 5.3 Flash
GLM · cafonez
Params321B
Context1024K
Smallest120.3 GB
ReasoningTool use
GL
GLM 5.3 0.6B A0.4B
GLM · mradermacher
Params622M
Context1024K
Q4_K_M0.4 GB
ReasoningTool use
LL
ZhangShenao SELM Llama 3 8B Instruct iter 1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED MTP Maya L
GLM · Adolphsson
Params564M
Context1024K
Smallest156.3 GB
Vision
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
UnifiedReward 2.0 Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Tool use

Keep browsing