GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Neurotic Experts 248x71M
Qwen · mradermacher
Params3.57B
Context32K
Q4_K_M2.5 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
JA
Janus Pro 7B LM
Janus · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
PH
Phi 4 Mini Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
US
UserLM 8b
Userlm · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AT
atllama.v3.5
Atllama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ornith-1.5-35B-A3B
Ornith · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
OR
Ornith 1.0 35B FP8 BLOCK MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · bartowski
Params218B
Context198K
Q4_K_M133.8 GB
QW
XueNian Qwen3 14B furry novel
Qwen · XueNian
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MiroThinker v1.0 8B
Mirothinker · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
SA
Saul Instruct v1
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Openhands Lm 1.5b v0.1
Openhands · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
R1
R1 1776
bartowski
Params671B
Context160K
Q4_K_M404.4 GB
OM
OmniDimen v2.5 4B Emotion
Omnidimen · OmniDimen
Params4.21B
Context256K
Q4_K_M2.7 GB
LI
ActQuant Pi05 LIBERO 4bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.6 GB
JI
jijun LM
Jijun · the-walking-fish
Params63M
Context1K
Smallest0.0 GB
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
EndConvo health 1b GGUF v1
Llama · ProdocAI
Params1.5B
Context128K
Smallest1.0 GB
SA
Saul 7B Base
Saul · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
MelloGPT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Seed Coder 8B Reasoning
Seed · second-state
Params8.25B
Context64K
Q4_K_M5.1 GB
FA
Fathom R1 14B RS
Fathom · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CA
cais Zephyr RMU
Cais · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwerus 7B i1
Qwerus · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llm4Decompile 22b v2
Llm · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
SA
Sarashina 13B Finetuned v1
Sarashina · mradermacher
Params13.7B
Context4K
Q4_K_M8.4 GB
RE
ReasonFlux Coder 14B
Reasonflux · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB