GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Privoid SQL Qwen3.5 2B
Qwen · Privoid-ai
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
AI
Airoboros 3b 3p11
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ME
megastudyedu M SOLAR 10.7B v1.2
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AI
airoboros-3b-3p11
Airoboros · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ZE
Zenz v3.1 Xsmall
Zenz · Miwa-Keita
Params26M
Context1K
Smallest0.0 GB
GGUF
RE
ResplendentAI Datura 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FS
FsfairX Zephyr Chat v0.1
Fsfairx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 0.1 Evil a AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AK
Akins 3B
Akins · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ZE
ZeusLabs L3 Aethora 15B V2
Zeuslabs · RichardErkhov
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
SP
Spaetzle v67 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zenzai plus
Zenz · soichi1208
Params95M
Context1K
Smallest0.2 GB
GGUF
HE
Kyutai.Helium 1 2b
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
MI
Mini DPO test02 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Pop
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
HE
Helium 1 2b Life
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
AY
aya expanse
Aya · cortexso
Params32.3B
Context8K
Q4_K_M5.1 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
CS
cstr Spaetzle v12 7b
Cstr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
kirk-tung
Kirk · wejjit
Params53M
Context1K
Q4_K_M0.0 GB
GGUF
BL
bling-stablelm-3b
Bling · llmware
Params2.8B
Context4K
Smallest1.7 GB
GGUF
MI
haryra 7b mistral id
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
rocket-3B
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
PA
Paradigm 7B i1
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
L3-Aethora-15B-V2
Llama · bullerwins
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
BL
.\BlackSheep MoE
Blacksheep · mradermacher
Params11.1B
Context16K
Q4_K_M6.7 GB
GGUF
AI
Airoboros 3b 3p11
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.8 27B
Qwen · federico-anastasi
Params27.4B
Context256K
Smallest9.5 GB
ReasoningTool use
PA
pagouro 1.0
Pagouro · Pagouro
Params1.04B
Context8K
Q4_K_M0.6 GB
GGUF

Keep browsing