GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi 2 logical sft
Phi · MaziyarPanahi
Params2.78B
Context4K
Q4_K_M1.7 GB
CodingReasoning
PH
Phi 3 medium 128k instruct IMat
Phi · legraphista
Params14B
Context128K
Smallest3.0 GB
GGUF
DE
deepseek ai DeepSeek R1 Distill Llama 8B GGUF smashed
DeepSeek · PrunaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
VP
VPPO 32B
Vppo · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Reasoning
RI
Ring Mini Sparse 2.0 Exp
Ring · mradermacher
Params16.3B
Context32K
Q4_K_M9.9 GB
Reasoning
FU
functionary small v2.5
Functionary · meetkai
Params8.03B
Context8K
Smallest4.7 GB
Tool use
LL
Llama 3.2 3B ImageGen
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
NE
Next 12b
Next · Lamapi
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
TO
ToolSpace 8B
Toolspace · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
ReasoningTool use
ON
oneirogen-1.5B
Oneirogen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
ReasoningTool use
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
AP
Apriel 1.6 15b Thinker Magic_alpha decensored_MPOA
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool useVision
MO
Mozi 2b
Mozi · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
NE
Next 70b
Next · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
gervasio 8b portuguese ptpt decoder
Llama · PORTULAN
Params8.03B
Context128K
Smallest16.1 GB
CodingTool use
US
UserRepGen 4B
Userrepgen · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Roblox Coder
Qwen · preferedev
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingReasoningTool use
HU
Huihui MiroThinker v1.0 30B Abliterated
Huihui · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
FA
FastContext 1.0 4B SFT Abliterated
Fastcontext · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
ME
MeowGPT ll3
Meowgpt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
BY
ByteCraft
Bytecraft · bartowski
Params8.39B
Context32K
Q4_K_M5.2 GB
Tool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · DhruvalLabs
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
SP
SpydazWebAI QuietStar Project
Spydazwebai · LeroyDyer
Params7.24B
Context128K
Q4_K_M4.4 GB
Coding
AT
Atlas Pro 7B Preview i1
Athena · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
PH
Phi 4 Mini Instruct Desyced
Phi · ApolloRaines
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
SE
Seed-Coder-8B-Reasoning
Seed · Mungert
Params8.25B
Context64K
Q4_K_M5.2 GB
CodingReasoning
GL
GLM 4.7 Flash
GLM · AaryanK
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use

Keep browsing