GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
QW
Privoid SQL Qwen3.5 2B
Qwen · Privoid-ai
Params1.94B
Context256K
Q4_K_M1.3 GB
AI
Airoboros 3b 3p11
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
ME
megastudyedu M SOLAR 10.7B v1.2
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
AI
airoboros-3b-3p11
Airoboros · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
ZE
Zenz v3.1 Xsmall
Zenz · Miwa-Keita
Params26M
Context1K
Smallest0.0 GB
RE
ResplendentAI Datura 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FS
FsfairX Zephyr Chat v0.1
Fsfairx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 0.1 Evil a AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
AK
Akins 3B
Akins · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
ZE
ZeusLabs L3 Aethora 15B V2
Zeuslabs · RichardErkhov
Params15B
Context8K
Q4_K_M9.1 GB
SP
Spaetzle v67 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zenzai plus
Zenz · soichi1208
Params95M
Context1K
Smallest0.2 GB
HE
Kyutai.Helium 1 2b
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
MI
Mini DPO test02 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Pop
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
HE
Helium 1 2b Life
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
AY
aya expanse
Aya · cortexso
Params32.3B
Context8K
Q4_K_M5.1 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
CS
cstr Spaetzle v12 7b
Cstr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
kirk-tung
Kirk · wejjit
Params53M
Context1K
Q4_K_M0.0 GB
BL
bling-stablelm-3b
Bling · llmware
Params2.8B
Context4K
Smallest1.7 GB
MI
haryra 7b mistral id
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
rocket-3B
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
PA
Paradigm 7B i1
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
L3-Aethora-15B-V2
Llama · bullerwins
Params15B
Context8K
Q4_K_M9.1 GB
BL
.\BlackSheep MoE
Blacksheep · mradermacher
Params11.1B
Context16K
Q4_K_M6.7 GB
AI
Airoboros 3b 3p11
Airoboros · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Qwen3.8 27B
Qwen · federico-anastasi
Params27.4B
Context256K
Smallest9.5 GB
PA
pagouro 1.0
Pagouro · Pagouro
Params1.04B
Context8K
Q4_K_M0.6 GB