GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · Kondara
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
GI
gigaam v3
Gigaam · cstr
Params221M
Context—
Smallest0.2 GB
GGUF
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
GGUF
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.89B
Context128K
Q4_K_M4.8 GB
Reasoning
LE
LegalOne 8B
Legalone · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GGUF
MI
Mini-Omni2
Mini · cstr
Params782M
Context—
Smallest1.1 GB
GGUF
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
VI
vicuna-7b-v1.5-safeunlearning
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OC
OceanGPT-7b-v0.1
Oceangpt · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CO
comfyui image models
Comfyui · ChuuniZ
Params11.9B
Context—
Smallest6.8 GB
GGUF
MI
Mistral-7B-v0.3-Chinese-Chat-uncensored
Mistral · stephenlzc
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
GGUF
ZE
huggingfaceh4_zephyr-7b-alpha
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
PII Model Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
GGUF
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
MA
MAmmoTH 7B
Mammoth · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GI
GigaChat 20B A3B instruct v1.5
Gigachat · ai-sage
Params20.6B
Context128K
Q4_K_M12.5 GB
GGUF
LO
lobe3 i1
Lobe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
KO
kokoro
Kokoro · mmwillet2
Params88M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 reap 200b
DeepSeek · puwaer
Params200B
Context—
Smallest0.3 GB
GGUF
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding

Keep browsing