GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
UL
UltraLink LM
Ultralink · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
Vision
QW
Qwen3.8 1.0B A0.6B
Qwen · TEKIBO
Params966M
Context256K
Smallest0.6 GB
GGUF
PH
phi 3 22b 128k i1
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
GGUF
PH
Phi 4 mini instruct heretic
Phi · richardyoung
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · VitreousCut
Params9.2B
Context256K
Q4_K_M6.1 GB
GGUF
PY
Pyrex 8B Instruct Uncensored
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
MagenticBrain
Magenticbrain · devehz
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
AU
AURA Eve Tactical Instruct 3.8B
Aura · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
SU
Sumo T9 7B v0.1 i1
Sumo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
FL
FluentlyLM Prinum Abliterated
Fluentlylm · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningRoleplay
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
AG
Agentflow Planner 7b
Agentflow · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
NE
Nexus 4x7B IKM MLX
Nexus · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
CO
CodeFuse SVR 8B
Codefuse · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
GO
GoLongRL 30B A3B
Golongrl · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
GGUF
QW
Qwen SEA LION v4 32B IT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
Vision
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
GGUF
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
HI
HiDream I1 Fast
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Keep browsing