GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
UnifiedReward Edit Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
BL
Q3.5 BlueStar v2 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
ST
STELLA VLM JoVE 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
SW
SWE Dev 32B
Swe · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
GGUF
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
PathFinder PRM 7B
Pathfinder · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
LZ
lzw1008 Emollama 7b
Lzw · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AL
ALMA 7B
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GT
gte-large
Gte · gianni-cor
Params334M
Context512
Smallest0.7 GB
GGUF
LI
Ling 3.0 Tiny
Ling · vincespeed
Params7.89B
Context128K
Smallest4.0 GB
ReasoningTool use
TI
tiny1m
Tiny · shibatch
Params—
Context256
Q4_K_M0.0 GB
GGUF
BI
bitnet b1 58 large TQ2 0
Bitnet · gianni-cor
Params729M
Context2K
Smallest0.2 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
OR
Ornith 1.5 9B NVFP4 MTP
Ornith · tiyuvta
Params9B
Context—
Smallest0.0 GB
GGUF
SV
SVGThinker 7B
Svgthinker · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
DE
DeepSeek V4 Flash DSpark drafter
DeepSeek · bleysg
Params19.8B
Context—
Smallest6.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
GL
GLM 4 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
NE
Next 1b
Next · thelamapi
Params1B
Context32K
Smallest1.1 GB
Coding
DE
DeepKAT 32B
Deepkat · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingReasoningTool use
AU
AURA Eve Tactical Instruct 3.8B
Aura · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NonMiFrega
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
IC
Icarus 1 8b
Icarus · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B Debiased
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
OP
Openhands Lm 7b v0.1
Openhands · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
WM
wmt21 dense 24 wide en x
Wmt · cstr
Params4.7B
Context—
Smallest2.7 GB
GGUF

Keep browsing