GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
GA
GaLLM multi 14B v0.1 i1
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
FR
Frost Cyber Mini 1.0
Frost · FrostWolfAI
Params4.21B
Context256K
Q4_K_M2.7 GB
DR
DRT 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
TL
tlphams zoyllm 7b slimorca
Tlphams · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
BatchOnline GRPO 1.5B
Batchonline · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
VO
Vocaela 2 500M 1024R2
Vocaela · vocaela
Params409M
Context8K
Smallest0.4 GB
QW
radcheck qwen35 9b gguf es
Qwen · Crstian19
Params8.95B
Context256K
Q4_K_M5.6 GB
DA
DataVortexS 10.7B Dpo v1.8
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
YO
You can cry Snowman 13B
You · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
WI
WikiQwen 4B
Wikiqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
NorskGPT Llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MY
Hypernova experimental
Mythomax · theNovaAI
Params13B
Context4K
Q4_K_M7.9 GB
DI
M DIE M 10.7B i1
Die · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
SOLARC MOE 10.7Bx6
Solarc · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.12
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
youjunhyeok llama3 koen 8b sft v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
RA
RAFT 1.5B
Raft · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
LlamaLens Native
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
orca mini 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Sakura 32B Qwen2beta v0.10pre1
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
SP
Splade V3
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
ME
MemoChat Vicuna 13B
Memochat · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
PA
PACK 13b v1.1
Pack · tensorblock
Params13B
Context4K
Smallest4.9 GB
CA
CarbonVillain En 10.7B v2
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
PY
supernova
Pygmalion · theNovaAI
Params13B
Context4K
Q4_K_M7.9 GB
DA
Edentns/DataVortexS-10.7B-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
KY
kyujinpy KoR Orca Platypus 13B
Kyujinpy · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
VO
voho saudi speak 0.6b
Voho · VohoAI
Params596M
Context40K
Q4_K_M0.4 GB
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
MK
MKLLM 7B Instruct
Mkllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB