GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PH
phi 2 logical sft
Phi · MaziyarPanahi
Params2.78B
Context4K
Q4_K_M1.7 GB
PH
Phi 3 medium 128k instruct IMat
Phi · legraphista
Params14B
Context128K
Smallest3.0 GB
DE
deepseek ai DeepSeek R1 Distill Llama 8B GGUF smashed
DeepSeek · PrunaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
VP
VPPO 32B
Vppo · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
RI
Ring Mini Sparse 2.0 Exp
Ring · mradermacher
Params16.3B
Context32K
Q4_K_M9.9 GB
FU
functionary small v2.5
Functionary · meetkai
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3.2 3B ImageGen
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
NE
Next 12b
Next · Lamapi
Params11.8B
Context128K
Q4_K_M7.3 GB
TO
ToolSpace 8B
Toolspace · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
ON
oneirogen-1.5B
Oneirogen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
AP
Apriel 1.6 15b Thinker Magic_alpha decensored_MPOA
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
MO
Mozi 2b
Mozi · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
NE
Next 70b
Next · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
gervasio 8b portuguese ptpt decoder
Llama · PORTULAN
Params8.03B
Context128K
Smallest16.1 GB
US
UserRepGen 4B
Userrepgen · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Roblox Coder
Qwen · preferedev
Params4.33B
Context256K
Q4_K_M2.8 GB
HU
Huihui MiroThinker v1.0 30B Abliterated
Huihui · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
FA
FastContext 1.0 4B SFT Abliterated
Fastcontext · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ME
MeowGPT ll3
Meowgpt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BY
ByteCraft
Bytecraft · bartowski
Params8.39B
Context32K
Q4_K_M5.2 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · DhruvalLabs
Params32.8B
Context128K
Q4_K_M19.9 GB
SP
SpydazWebAI QuietStar Project
Spydazwebai · LeroyDyer
Params7.24B
Context128K
Q4_K_M4.4 GB
AT
Atlas Pro 7B Preview i1
Athena · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
PH
Phi 4 Mini Instruct Desyced
Phi · ApolloRaines
Params3.84B
Context128K
Q4_K_M2.5 GB
SE
Seed-Coder-8B-Reasoning
Seed · Mungert
Params8.25B
Context64K
Q4_K_M5.2 GB
GL
GLM 4.7 Flash
GLM · AaryanK
Params29.9B
Context198K
Q4_K_M18.1 GB