GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
strela
Strela · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
HE
Helium 1 2b
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
GGUF
SP
Spaetzle v12 7b
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
SO
megastudyedu/M-SOLAR-10.7B-v1.2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EP
Epstein
Epstein · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SU
Suzu 2
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
GGUF
LL
shivanikerai llama 3 sqlcoder 8b v1.0
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
QW
OpenChoice 9B
Qwen · Lutr0
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
MA
maywell Synatra 7B v0.3 QA
Maywell · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spaetzle v8 7b orpo2
Spaetzle · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
BL
.\BlackSheep MoE
Blacksheep · mradermacher
Params11.1B
Context16K
Q4_K_M6.7 GB
GGUF
AL
ALIA 40b
Alia · aitups
Params41.1B
Context4K
Smallest25.5 GB
GGUF
MI
gua a v0.2 dpo mistral 7b
Mistral · thinkPy
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoning
ZE
zenz-v2
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
GGUF
LL
Luna-AI-Llama2-Uncensored
Llama · alexlawless
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
BI
BiMediX 3 1 70B LLM
Bimedix · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QI
T5 Qiita Title Generation
Qiita · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
FL
Spaetzle v8 7b
Flora · cstr
Params7.24B
Context32K
Smallest4.4 GB
GGUF
PI
PiVoT 0.1 Evil A
Pivot · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Smallest10.4 GB
GGUF
SU
Suzu 2.1
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
GGUF
LL
llama 3 sqlcoder 8b Q8 0
Llama · jesse-r-s-hines
Params8.03B
Context8K
Smallest8.5 GB
Coding
YU
croguana RC2
Yugogpt · Shome
Params7.24B
Context32K
Smallest5.1 GB
GGUF
PI
PiVoT 0.1 Early
Pivot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SQ
sqlcoder 7b 2 Q4 K M
Sqlcoder · jesse-r-s-hines
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HA
Haruhi Zero 6B 0.1
Haruhi · fengpeisheng1
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
EL
elitegpt
Elitegpt · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
thadou kuki qwen3 4b lora
Qwen · Prompt48
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LL
llama 3 sqlcoder 8b Q4 K M
Llama · jesse-r-s-hines
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding

Keep browsing