GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CH
Chocolatine 2 14B Instruct v2.0 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
GL
GLM 4.7 Flash REAP 19
GLM · mradermacher
Params24.7B
Context198K
Q4_K_M15.0 GB
CodingReasoningTool use
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
BG
bge m3
BGE · vonjack
Params567M
Context8K
Smallest0.6 GB
Embedding
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MI
Heidrun Mistral 7B chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OR
Ornith1.5 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
SA
Saul Instruct v1 i1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
ReasoningTool useVision
MI
MiMo V2.6 Flash MOPD MXFP4
Mimo · kernelpool
Params310B
Context1024K
Smallest0.8 GB
GGUF
ZE
zephyr 7b alpha
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Atlas Pro 7B Preview 1M i1
Athena · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
CA
Carrot-Ko-2.1B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
GGUF
SP
SPEED 1 BASE
Speed · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
Reasoning
QW
UnifiedReward Flex Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
WA
wavecoder ultra 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
IR
irodori tts voicedesign
Irodori · cstr
Params71M
Context—
Smallest0.1 GB
GGUF
OR
Ornith 1.0 397B
Ornith · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
ReasoningTool useVision
BE
Beck 0.6B
Beck · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GL
zai org.GLM 5.2
GLM · DevQuasar
Params753B
Context1024K
Q4_K_M454.6 GB
ReasoningTool use
QW
Pokemon Red Qwen3 80B
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Tool use
SO
SongGeneration v2 large
Songgeneration · smthem
Params5.12B
Context—
Smallest6.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · SanctumAI
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GP
GPT4chan 24B
Gpt · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
LaSER Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
EmbeddingReasoningTool use

Keep browsing