GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GU
GUI Owl 1.5 32B Think
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
ReasoningTool useVision
MY
Mythos Nano
Mythos · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
AL
X ALMA 13B Group4
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SI
Sidon
Sidon · cstr
Params1M
Context—
Smallest0.0 GB
GGUF
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · ThomasBaruzier
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MI
MiroThinker v1.0 72B
Mirothinker · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
PH
Phi 3 mini 4k instruct v0.3
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LI
Ling 3.0 Flash
Ling · WhiskyAKM
Params127B
Context256K
Q4_K_M77.0 GB
ReasoningTool use
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · botp
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
VG
VGPO RL 7B
Vgpo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
GGUF
SW
SWE Star 7B
Swe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SA
SaulLM 141 Base i1
Saullm · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
PH
calme 2.3 phi3 4b
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GU
GUI Decisions 2B
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
Tool useVision
TE
TEA ASR 1.1
Tea · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
CodingVision
LI
Lingshu 7B
Lingshu · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool useVision
DE
Deepcogito.Cogito v2 Preview Deepseek 671B MoE
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
JI
JiRackUltra_1b
Jirackultra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
GL
GLM Z1 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
MA
Mammoth 1
Mammoth · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
ST
StructLM 7B
Structlm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · second-state
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
PA
MS3.2 PaintedFantasy v4 24B Absolute Heresy
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
GP
Gpt Oss 20b Offload
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
OR
cn3nctie2nc92bbc9nxxj93
Ornith · AIGAROU
Params447M
Context256K
Smallest12.7 GB
Vision

Keep browsing