GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 tiny 256K
Ling · stornic56
Params7.89B
Context256K
Q4_K_M4.9 GB
GGUF
LL
LLaDA 8B Tools
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
Tool use
FU
functionary small v2.4
Functionary · meetkai
Params7.24B
Context32K
Smallest4.1 GB
Tool use
HA
hammerllm 1.4b 522k
Hammerllm · mradermacher
Params1.4B
Context2K
Q4_K_M0.9 GB
GGUF
QO
QoQ Med3 VL 8B
Qoq · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
GGUF
PA
Papagaio
Papagaio · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
FR
FrogBoss 32B 2510
Frogboss · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
DO
Dots.Ocr
Dots · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingVision
RS
RSCoVLM Det 7B 2512
Rscovlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
YU
Yugo60 GPT
Yugo · datatab
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LLaDA 8B Instruct
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
GGUF
MI
MiroThinker v1.5 30B Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
DU
Ai Dungeon Large En
Dungeon · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
SC
SCOPED 8B
Scoped · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
KA
KaLM Embedding Multilingual Mini v1
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Embedding
GL
Huihui ai.GLM 4 9B 0414 Abliterated
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
FR
FrogNano 4B 2609
Frognano · richardyoung
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
GL
GLM 4 32B 0414
GLM · lmstudio-community
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
AU
Audiotoaudiotranslate
Audiotoaudiotranslate · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
DE
DeepScaleR 1.5B Preview
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
llama 2 tiny random
Llama · aladar
Params—
Context4K
Smallest0.0 GB
GGUF
HT
HTDemucs (htdemucs)
Htdemucs · cstr
Params42M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1
DeepSeek · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AU
AutoGLM Phone 9B
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
GGUF

Keep browsing