GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 4.7 Flash Coder
GLM · ali-sys-1370
Params29.9B
Context198K
Q4_K_M18.1 GB
Coding
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · mradermacher
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
ZE
Zeta 4.5
Zeta · mradermacher
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
VI
Vision Matters 7B
Vision · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
GL
glm 5.2
GLM · antirez
Params754B
Context1024K
Smallest211.1 GB
ReasoningTool use
PH
TaliML PHI3 128K ITA V.1.0.FINAL i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MI
Mixtral BioMedical i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
NA
NatureLM 8x7B Inst
Naturelm · mradermacher
Params46.8B
Context32K
Q4_K_M28.5 GB
GGUF
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
OR
Ornith 1.5 35B A3B APEX
Ornith · Myric
Params35.5B
Context256K
Smallest12.6 GB
ReasoningTool use
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
LL
Maestro R1 Llama 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
LightThinker Plus Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
NU
NuExtract 2.0 2B
Nuextract · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
TwinFlow Qwen Image v1.0 diffusers
Qwen · smthem
Params20.4B
Context—
Smallest9.0 GB
GGUF
GL
GLM-4.6V-Flash
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
ReasoningTool useVision
CH
Chocolatine 14B Instruct 4k DPO
Chocolatine · tensorblock
Params14B
Context4K
Smallest5.1 GB
GGUF
LI
Ring Flash 2.0
Ling · redponike
Params103B
Context32K
Q4_K_M62.4 GB
GGUF
QW
CoReward Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
ST
StructLM 13B
Structlm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
CH
Chocolatine 2 14B Instruct v2.0b2 i1
Chocolatine · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
VI
vibevoice-7b
Vibevoice · cstr
Params9.34B
Context—
Smallest6.2 GB
GGUF
FU
functionary small v3.2
Functionary · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LL
LLM AI Server
Llm · mmkurodan
Params2M
Context128
Q4_K_M0.0 GB
GGUF
GL
AutoGLM-Phone-9B
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
CH
ChatFrame
Chatframe · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MiroThinker v1.5 30B Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
PL
Planium 4B
Planium · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use

Keep browsing