GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LI
Ling 3.0 tiny 256K
Ling · stornic56
Params7.89B
Context256K
Q4_K_M4.9 GB
LL
LLaDA 8B Tools
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
FU
functionary small v2.4
Functionary · meetkai
Params7.24B
Context32K
Smallest4.1 GB
HA
hammerllm 1.4b 522k
Hammerllm · mradermacher
Params1.4B
Context2K
Q4_K_M0.9 GB
QO
QoQ Med3 VL 8B
Qoq · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
PA
Papagaio
Papagaio · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
FR
FrogBoss 32B 2510
Frogboss · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DO
Dots.Ocr
Dots · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
RS
RSCoVLM Det 7B 2512
Rscovlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
YU
Yugo60 GPT
Yugo · datatab
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LLaDA 8B Instruct
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
MI
MiroThinker v1.5 30B Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DU
Ai Dungeon Large En
Dungeon · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
SC
SCOPED 8B
Scoped · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
KA
KaLM Embedding Multilingual Mini v1
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GL
Huihui ai.GLM 4 9B 0414 Abliterated
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
FR
FrogNano 4B 2609
Frognano · richardyoung
Params4.33B
Context256K
Q4_K_M2.8 GB
GL
GLM 4 32B 0414
GLM · lmstudio-community
Params32.6B
Context32K
Q4_K_M19.7 GB
AU
Audiotoaudiotranslate
Audiotoaudiotranslate · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
llama 2 tiny random
Llama · aladar
Params—
Context4K
Smallest0.0 GB
HT
HTDemucs (htdemucs)
Htdemucs · cstr
Params42M
Context—
Smallest0.0 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
DE
DeepSeek R1 ReDistill Qwen 1.5B v1.1
DeepSeek · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
AU
AutoGLM Phone 9B
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB