GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LI
LiteCoder Terminal 30b A3B Sft
Litecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GA
GALAX i1
Galax · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 Mini 4k Instruct
Phi · brittlewis12
Params3.82B
Context4K
Q4_K_M2.4 GB
LI
Ling Lite Base
Ling · mradermacher
Params16.8B
Context16K
Q4_K_M11.2 GB
DE
DeepSeek V4.1 Flash Skeleton
DeepSeek · agentionai
Params30.4B
Context1024K
Smallest20.4 GB
CA
calme-2.3-rys-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
DO
Dots.Ocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
UnifiedReward Flex Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
OP
All Hands.Openhands Lm 1.5b v0.1
Openhands · DevQuasar-11
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
state-0
State · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
UnifiedReward Edit Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
OP
OpenResearcher 30B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
MI
CWC Mistral Nemo 12B V2 q4 k m
Mistral · CWClabs
Params12.2B
Context128K
Q4_K_M7.5 GB
QC
QCOPM-40B-A5B
Qcopm · thehekimoghlu
Params34.7B
Context—
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
PH
dolphin 2.9.2 Phi 3 Medium
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
DE
Deepseek R1 8b Abliterated Q4
DeepSeek · RuCoverLAB
Params8.03B
Context128K
Q4_K_M4.9 GB
LI
Ling 3.0 Tiny
Ling · erenyeager-1
Params7.89B
Context128K
Q4_K_M4.9 GB
SE
Secretmodel Indevelopment Full Testing
Secretmodel · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
QW
UnifiedReward Think Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
QwQ 32B ARPO DeepSearch
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.9 GB
MI
MiMo VL 7B SFT
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PP
Pplx Embed v1 4b
Pplx · mykor
Params4.02B
Context32K
Q4_K_M2.5 GB
GE
Gemma SEA LION Guard v2 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Q4_K_M9.0 GB
GP
Gpt Oss 20b Ru Reasoner
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GI
GigaChat3 10B A1.8B base
Gigachat · FriskyFennec
Params10.7B
Context256K
Q4_K_M6.5 GB
SA
sarashina2 7b
Sarashina · QuantFactory
Params7.32B
Context4K
Q4_K_M4.5 GB
SE
Sea Lion 7b
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB