GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
LiteCoder Terminal 30b A3B Sft
Litecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
GA
GALAX i1
Galax · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · brittlewis12
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LI
Ling Lite Base
Ling · mradermacher
Params16.8B
Context16K
Q4_K_M11.2 GB
GGUF
DE
DeepSeek V4.1 Flash Skeleton
DeepSeek · agentionai
Params30.4B
Context1024K
Smallest20.4 GB
GGUF
CA
calme-2.3-rys-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
DO
Dots.Ocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingVision
QW
UnifiedReward Flex Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
OP
All Hands.Openhands Lm 1.5b v0.1
Openhands · DevQuasar-11
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
ST
state-0
State · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
UnifiedReward Edit Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
DE
Janus Pro 7B
DeepSeek · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
GGUF
OP
OpenResearcher 30B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
MI
CWC Mistral Nemo 12B V2 q4 k m
Mistral · CWClabs
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
QC
QCOPM-40B-A5B
Qcopm · thehekimoghlu
Params34.7B
Context—
Q4_K_M21.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
GGUF
PH
dolphin 2.9.2 Phi 3 Medium
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
DE
Deepseek R1 8b Abliterated Q4
DeepSeek · RuCoverLAB
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LI
Ling 3.0 Tiny
Ling · erenyeager-1
Params7.89B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
SE
Secretmodel Indevelopment Full Testing
Secretmodel · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
QW
UnifiedReward Think Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
QW
QwQ 32B ARPO DeepSearch
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
MI
MiMo VL 7B SFT
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
PP
Pplx Embed v1 4b
Pplx · mykor
Params4.02B
Context32K
Q4_K_M2.5 GB
Embedding
GE
Gemma SEA LION Guard v2 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
GP
Gpt Oss 20b Ru Reasoner
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
ReasoningTool use
GI
GigaChat3 10B A1.8B base
Gigachat · FriskyFennec
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
SA
sarashina2 7b
Sarashina · QuantFactory
Params7.32B
Context4K
Q4_K_M4.5 GB
GGUF
SE
Sea Lion 7b
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB
GGUF

Keep browsing