GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Kondara
Params7.62B
Context128K
Q4_K_M4.7 GB
GI
gigaam v3
Gigaam · cstr
Params221M
Context—
Smallest0.2 GB
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
LE
LegalOne 8B
Legalone · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
MI
Mini-Omni2
Mini · cstr
Params782M
Context—
Smallest1.1 GB
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
VI
vicuna-7b-v1.5-safeunlearning
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OC
OceanGPT-7b-v0.1
Oceangpt · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
CO
comfyui image models
Comfyui · ChuuniZ
Params11.9B
Context—
Smallest6.8 GB
MI
Mistral-7B-v0.3-Chinese-Chat-uncensored
Mistral · stephenlzc
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
ZE
huggingfaceh4_zephyr-7b-alpha
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
PII Model Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
MA
MAmmoTH 7B
Mammoth · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GI
GigaChat 20B A3B instruct v1.5
Gigachat · ai-sage
Params20.6B
Context128K
Q4_K_M12.5 GB
LO
lobe3 i1
Lobe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
KO
kokoro
Kokoro · mmwillet2
Params88M
Context—
Smallest0.2 GB
DE
DeepSeek V4 Flash 0731 reap 200b
DeepSeek · puwaer
Params200B
Context—
Smallest0.3 GB
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB