GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
NE
Next 1b
Next · mattritchey
Params1B
Context32K
Q4_K_M0.8 GB
Coding
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
NO
Nous Capybara 7B
Nous · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
Vision
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
CodingReasoning
RI
Ring Mini 2.0
Ring · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TO
ToolSpace 8B
Toolspace · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
ReasoningTool use
OT
Other Test GGUFs
Other · ToastyPigeon
Params27.3B
Context256K
Smallest9.5 GB
ReasoningTool use
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
SH
shisa v2.1 unphi4 14b
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Ornith 1.5 35B A3B BigBang MTP
Ornith · EryriLabs
Params1.86B
Context256K
Q4_K_M21.2 GB
GGUF
DE
DeepPresenter 9B
Deeppresenter · Forceless
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
CH
Chocolatine 14B Instruct DPO v1.1 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
CY
BaronLLM Offensive Security abliterated
Cybersecurity · huihui-ai
Params8B
Context—
Smallest6.6 GB
GGUF
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
FU
functionary small v3.2
Functionary · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
JP
jpacifico Chocolatine 14B Instruct DPO v1.2
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
SK
SkinTokens TokenRig
Skintokens · LocalAI-io
Params29M
Context—
Smallest0.1 GB
GGUF

Keep browsing