GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
AC
AceTranslatePro models
Acetranslatepro · tianclll
Params1.78B
Context256K
Q4_K_M1.1 GB
Tool useVision
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
GL
GLM 5.3 Flash
GLM · AshwinX
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
BL
Q3.5 BlueStar v2 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
PU
PulseMind 72B
Pulsemind · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
ReasoningVision
LL
Saiga Llama3 L3 Stheno 8B v3.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
AB
Abacus Cve v1.1
Abacus · mradermacher
Params32.8B
Context64K
Q4_K_M19.8 GB
CodingReasoningTool use
FR
FriendModel 112M
Friendmodel · GlowingLanternAIQuest
Params163M
Context2K
Smallest0.2 GB
GGUF
FA
Fathom R1 14B
Fathom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MO
MOA
Moa · MOAIIA
Params3B
Context32K
Smallest2.1 GB
GGUF
CA
CAT Translate 0.8b
Cat · mmnga-o
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
RI
Rio 3.1 Open 30B VL
Rio · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
PH
PhysX Omni
Physx · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
TA
TAMA vB i1
Tama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
bitnet embedding 270m
Bitnet · microsoft
Params268M
Context32K
Smallest0.4 GB
Embedding
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
OR
Ornith1.5 9B 3MPER0RR Obliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 2B Ideal TSUNDERE Loli Girl Japanese v1
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
OR
Ornith1.5 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
MI
MiMo V2.6 Pro Uncensored Maya
Mimo · nofacedfl
Params1020B
Context1024K
Smallest300.3 GB
ReasoningTool useVision
LI
Ling 1T
Ling · honda6666
Params1000B
Context32K
Smallest231.3 GB
ReasoningTool use
PH
Phi 3.5 mini 3.8B ArliAI RPMax v1.1
Phi · ArliAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GL
GLM 4.1V 9B Thinking
GLM · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
Reasoning
SE
Seed Coder 8B Instruct
Seed · gaianet
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
KI
Kimi VL A3B Thinking 2506
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
ReasoningVision
SI
silero lid lang95
Silero · cstr
Params4M
Context—
Smallest0.0 GB
GGUF
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · llmfan46
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use

Keep browsing