GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GU
GUI Owl 1.5 32B Think
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
MY
Mythos Nano
Mythos · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
AL
X ALMA 13B Group4
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SI
Sidon
Sidon · cstr
Params1M
Context—
Smallest0.0 GB
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1
DeepSeek · ThomasBaruzier
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MiroThinker v1.0 72B
Mirothinker · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
PH
Phi 3 mini 4k instruct v0.3
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
LI
Ling 3.0 Flash
Ling · WhiskyAKM
Params127B
Context256K
Q4_K_M77.0 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · botp
Params29.9B
Context198K
Q4_K_M18.5 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
VG
VGPO RL 7B
Vgpo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
SW
SWE Star 7B
Swe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
SaulLM 141 Base i1
Saullm · mradermacher
Params141B
Context64K
Smallest29.6 GB
PH
calme 2.3 phi3 4b
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GU
GUI Decisions 2B
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
TE
TEA ASR 1.1
Tea · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
LI
Lingshu 7B
Lingshu · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
Deepcogito.Cogito v2 Preview Deepseek 671B MoE
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
JI
JiRackUltra_1b
Jirackultra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Q4_K_M2.5 GB
GL
GLM Z1 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
MA
Mammoth 1
Mammoth · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
ST
StructLM 7B
Structlm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · second-state
Params8.19B
Context128K
Q4_K_M5.0 GB
PA
MS3.2 PaintedFantasy v4 24B Absolute Heresy
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GP
Gpt Oss 20b Offload
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
OR
cn3nctie2nc92bbc9nxxj93
Ornith · AIGAROU
Params447M
Context256K
Smallest12.7 GB