GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
Seed Coder 8B Instruct
Seed · second-state
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
GL
GLM 5.3 Flash
GLM · muterornament
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SP
SP3F 7B
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
SvS Qwen Code 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MU
multilingual e5 base Q4 K M
Multilingual · dinab
Params277M
Context512
Q4_K_M0.2 GB
Embedding
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
GL
GLM 4.7 Flash abliterated 12GB
GLM · cognitivers
Params29.9B
Context198K
Smallest0.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
GL
GLM4 32B Neon v2
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
ON
Oneirogen 7B Abominable Heresy
Oneirogen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Cybersecurity BaronLLM Offensive Security LLM Q6 K
Llama · AlicanKiraz0
Params8.03B
Context128K
Smallest6.6 GB
Tool use
DE
DeepSeek V4 Flash Vision Exp Abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool useVision
CH
chatterbox nano
Chatterbox · cstr
Params180M
Context—
Smallest0.3 GB
GGUF
GE
Survival Uncensored Gemma 270m v2
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
OR
Ornith 1.0 9B Abliterated Fable
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
GL
GLM 5.3 Flash
GLM · Dgvdhb
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
KO
Kosolra Kullm LDCC Merge
Kosolra · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mmnga
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
TI
Tini1.5-8B-A1B
Tini · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
LI
lion 7b i1
Lion · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · Sci-fi-vy
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
GL
GLM-5.3-Flash
GLM · vultr
Params313B
Context1024K
Q4_K_M208.2 GB
ReasoningTool useVision
BE
BEPA 7B S2
Bepa · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
ME
MedAssistant 8B
Medassistant · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
GGUF

Keep browsing