GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GA
GaLLM multi 14B v0.1 i1
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
FR
Frost Cyber Mini 1.0
Frost · FrostWolfAI
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
DR
DRT 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
TL
tlphams zoyllm 7b slimorca
Tlphams · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
BatchOnline GRPO 1.5B
Batchonline · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
VO
Vocaela 2 500M 1024R2
Vocaela · vocaela
Params409M
Context8K
Smallest0.4 GB
Vision
QW
radcheck qwen35 9b gguf es
Qwen · Crstian19
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DA
DataVortexS 10.7B Dpo v1.8
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YO
You can cry Snowman 13B
You · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
WI
WikiQwen 4B
Wikiqwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
LL
NorskGPT Llama3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MY
Hypernova experimental
Mythomax · theNovaAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DI
M DIE M 10.7B i1
Die · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLARC MOE 10.7Bx6
Solarc · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.12
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
youjunhyeok llama3 koen 8b sft v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RA
RAFT 1.5B
Raft · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
LL
LlamaLens Native
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
OR
orca mini 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Sakura 32B Qwen2beta v0.10pre1
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
GGUF
SP
Splade V3
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
ME
MemoChat Vicuna 13B
Memochat · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PA
PACK 13b v1.1
Pack · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
CA
CarbonVillain En 10.7B v2
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PY
supernova
Pygmalion · theNovaAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DA
Edentns/DataVortexS-10.7B-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KY
kyujinpy KoR Orca Platypus 13B
Kyujinpy · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
VO
voho saudi speak 0.6b
Voho · VohoAI
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
MK
MKLLM 7B Instruct
Mkllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing