GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
GGUF
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · BasedAGI
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
HO
HOT Step CPP SuperSep
Hot · scragnog
Params67M
Context—
Smallest0.3 GB
GGUF
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
FR
FrogNano 4B 2609 Pollard
Frognano · PollardWeights
Params4.33B
Context256K
Smallest1.4 GB
Vision
BA
BashCopilot 6B Preview
Bashcopilot · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
Coding
MI
MiMo V2.6 Flash MOPD NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
Coding
NU
NuExtract 2.0 2B
Nuextract · numind
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
OR
VELUM Coder
Ornith · guell00
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
LLaMAX2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
ZhangShenao SELM Llama 3 8B Instruct iter 2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
UnifiedReward 2.0 Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
FI
fietje 2
Fietje · BramVanroy
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SP
SparkVSR
Sparkvsr · smthem
Params5.57B
Context—
Smallest7.9 GB
GGUF
MI
Mistral-C2F-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
VibeThinker 3B heretic
Qwen · saidutta69
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
GE
GenPRM 7B
Genprm · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
Vision
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
GGUF
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GL
GLM 4 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
QW
AceCoder Qwen2.5 Coder 7B Ins V1.1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CH
Chocolatine 3B Instruct DPO Revised i1
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
Abliterated MiMo V2.6 Distill Qwen 9B GGUF MLX
Qwen · 0xSojalSec
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GL
GLM 5.3 Flash
GLM · marcorez8
Params321B
Context1024K
Smallest0.0 GB
Vision

Keep browsing