GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen3 Neurotic Experts 248x71M
Qwen · mradermacher
Params3.57B
Context32K
Q4_K_M2.5 GB
GGUF
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
JA
Janus Pro 7B LM
Janus · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
GGUF
PH
Phi 4 Mini Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
US
UserLM 8b
Userlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AT
atllama.v3.5
Atllama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OR
Ornith-1.5-35B-A3B
Ornith · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
OR
Ornith 1.0 35B FP8 BLOCK MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · bartowski
Params218B
Context198K
Q4_K_M133.8 GB
ReasoningTool use
QW
XueNian Qwen3 14B furry novel
Qwen · XueNian
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MI
MiroThinker v1.0 8B
Mirothinker · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
SA
Saul Instruct v1
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Openhands Lm 1.5b v0.1
Openhands · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
R1
R1 1776
bartowski
Params671B
Context160K
Q4_K_M404.4 GB
ReasoningTool use
OM
OmniDimen v2.5 4B Emotion
Omnidimen · OmniDimen
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
LI
ActQuant Pi05 LIBERO 4bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.6 GB
GGUF
JI
jijun LM
Jijun · the-walking-fish
Params63M
Context1K
Smallest0.0 GB
Tool use
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
EndConvo health 1b GGUF v1
Llama · ProdocAI
Params1.5B
Context128K
Smallest1.0 GB
Tool use
SA
Saul 7B Base
Saul · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MI
MelloGPT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
Seed Coder 8B Reasoning
Seed · second-state
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
FA
Fathom R1 14B RS
Fathom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
CA
cais Zephyr RMU
Cais · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwerus 7B i1
Qwerus · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
Llm4Decompile 22b v2
Llm · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
SA
Sarashina 13B Finetuned v1
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
RE
ReasonFlux Coder 14B
Reasonflux · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use

Keep browsing