GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chocolatine 2 14B Instruct v2.0 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
GLM 4.7 Flash REAP 19
GLM · mradermacher
Params24.7B
Context198K
Q4_K_M15.0 GB
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
BG
bge m3
BGE · vonjack
Params567M
Context8K
Smallest0.6 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Heidrun Mistral 7B chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Ornith1.5 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SA
Saul Instruct v1 i1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
MI
MiMo V2.6 Flash MOPD MXFP4
Mimo · kernelpool
Params310B
Context1024K
Smallest0.8 GB
ZE
zephyr 7b alpha
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
AT
Atlas Pro 7B Preview 1M i1
Athena · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
CA
Carrot-Ko-2.1B-Instruct
Carrot · mradermacher
Params2.34B
Context32K
Q4_K_M1.5 GB
SP
SPEED 1 BASE
Speed · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
QW
UnifiedReward Flex Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
WA
wavecoder ultra 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
IR
irodori tts voicedesign
Irodori · cstr
Params71M
Context—
Smallest0.1 GB
OR
Ornith 1.0 397B
Ornith · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
BE
Beck 0.6B
Beck · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
GL
zai org.GLM 5.2
GLM · DevQuasar
Params753B
Context1024K
Q4_K_M454.6 GB
QW
Pokemon Red Qwen3 80B
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
SO
SongGeneration v2 large
Songgeneration · smthem
Params5.12B
Context—
Smallest6.9 GB
PH
Phi 3.5 Mini Instruct
Phi · SanctumAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GP
GPT4chan 24B
Gpt · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
LaSER Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB