GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · BasedAGI
Params23.6B
Context128K
Q4_K_M14.3 GB
HO
HOT Step CPP SuperSep
Hot · scragnog
Params67M
Context—
Smallest0.3 GB
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
FR
FrogNano 4B 2609 Pollard
Frognano · PollardWeights
Params4.33B
Context256K
Smallest1.4 GB
BA
BashCopilot 6B Preview
Bashcopilot · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
MiMo V2.6 Flash MOPD NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
NU
NuExtract 2.0 2B
Nuextract · numind
Params1.54B
Context32K
Q4_K_M1.0 GB
OR
VELUM Coder
Ornith · guell00
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
LightGPT 7B Qwen2
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
LLaMAX2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
UnifiedReward 2.0 Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
FI
fietje 2
Fietje · BramVanroy
Params2.78B
Context2K
Q4_K_M1.7 GB
SP
SparkVSR
Sparkvsr · smthem
Params5.57B
Context—
Smallest7.9 GB
MI
Mistral-C2F-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
VibeThinker 3B heretic
Qwen · saidutta69
Params3.09B
Context128K
Q4_K_M1.9 GB
GE
GenPRM 7B
Genprm · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GL
GLM 4 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
QW
AceCoder Qwen2.5 Coder 7B Ins V1.1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CH
Chocolatine 3B Instruct DPO Revised i1
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Abliterated MiMo V2.6 Distill Qwen 9B GGUF MLX
Qwen · 0xSojalSec
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM 5.3 Flash
GLM · marcorez8
Params321B
Context1024K
Smallest0.0 GB