GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
ST
strela
Strela · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
HE
Helium 1 2b
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
SP
Spaetzle v12 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
EP
Epstein
Epstein · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SU
Suzu 2
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
LL
shivanikerai llama 3 sqlcoder 8b v1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
OpenChoice 9B
Qwen · Lutr0
Params8.95B
Context256K
Q4_K_M5.6 GB
MA
maywell Synatra 7B v0.3 QA
Maywell · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spaetzle v8 7b orpo2
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
BL
.\BlackSheep MoE
Blacksheep · mradermacher
Params11.1B
Context16K
Q4_K_M6.7 GB
AL
ALIA 40b
Alia · aitups
Params41.1B
Context4K
Smallest25.5 GB
MI
gua a v0.2 dpo mistral 7b
Mistral · thinkPy
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zenz-v2
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
LL
Luna-AI-Llama2-Uncensored
Llama · alexlawless
Params6.74B
Context2K
Q4_K_M4.1 GB
BI
BiMediX 3 1 70B LLM
Bimedix · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QI
T5 Qiita Title Generation
Qiita · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
FL
Spaetzle v8 7b
Flora · cstr
Params7.24B
Context32K
Smallest4.4 GB
PI
PiVoT 0.1 Evil A
Pivot · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
SU
Suzu 2.1
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
LL
llama 3 sqlcoder 8b Q8 0
Llama · jesse-r-s-hines
Params8.03B
Context8K
Smallest8.5 GB
YU
croguana RC2
Yugogpt · Shome
Params7.24B
Context32K
Smallest5.1 GB
PI
PiVoT 0.1 Early
Pivot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SQ
sqlcoder 7b 2 Q4 K M
Sqlcoder · jesse-r-s-hines
Params6.74B
Context16K
Q4_K_M4.1 GB
HA
Haruhi Zero 6B 0.1
Haruhi · fengpeisheng1
Params6.06B
Context4K
Q4_K_M3.7 GB
EL
elitegpt
Elitegpt · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
thadou kuki qwen3 4b lora
Qwen · Prompt48
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
llama 3 sqlcoder 8b Q4 K M
Llama · jesse-r-s-hines
Params8.03B
Context8K
Q4_K_M4.9 GB