GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DevilsAdvocate 8B
Devilsadvocate · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.8 Flash Next GGUF HALO
Qwen · Beinsezii
Params180B
Context256K
Smallest0.6 GB
GGUF
AU
AutoGLM Phone 9B
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
GGUF
QW
UnifiedReward 2.0 Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Deekseek R1 Qwen3 8b
Qwen · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
OR
Ornith 1.0 9B Heretic MTP
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
GGUF
QW
Majority Voting Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QO
QoQ Med VL 32B
Qoq · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoningTool use
GT
gte-small
Gte · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
Embedding
CL
clipclap
Clipclap · antflydb
Params69M
Context—
Smallest0.0 GB
GGUF
QW
UnifiedReward Edit Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
DE
deepseek r1 14b
DeepSeek · PsiPi
Params14.8B
Context128K
Smallest9.0 GB
ReasoningTool use
FI
fietje 2 instruct i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MI
Mixtral AI CyberBrain 3 0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
WE
WebGen LM 7B
Webgen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CY
Cydonia v1.3 Magnum V4 22B i1
Cydonia · BasedAGI
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
JO
JOSIE 2 9B OSS
Josie · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Anki Qwen 2.5
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Tool use
FA
Fara1.5 27B
Fara · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
AU
AURORAV0.3 4B
Aurorav · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
ReasoningRoleplay
TE
TextLap COCO
Textlap · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AN
M3.2 24B Animus V7.0
Animus · Darkhn-Quants
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
PA
PathFinder PRM 7B
Pathfinder · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · jackklki990
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
LLaMAX2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Nous-Capybara-3B-V1.9
Nous · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
GL
THUDM/GLM-Z1-32B-0414
GLM · DevQuasar-13
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF

Keep browsing