GGUF models: cc-by-nc-2.0 license

74 GGUF models listed under the cc-by-nc-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 69M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
BL
BlackSheep 24B
Blacksheep · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
TA
MN 12B Tarsus iMat
Tarsus · Quant-Cartel
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CA
Cabra 72b
Cabra · mradermacher
Params72.3B
Context32K
Q4_K_M44.1 GB
GGUF
TA
MN 12B Tarsus i1
Tarsus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CO
Command A 111B Animus V13.0
Command · Darkhn-Quants-3
Params111B
Context128K
Q4_K_M67.1 GB
RoleplayTool use
LA
laserxtral
Laserxtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
SA
Sanskrit Translate V1.0
Sanskrit · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
FINETUNED MEDICAL LLAMA 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TR
TriFusionNexus 7b
Trifusionnexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
botbot-ai/CabraLlama3-8b
Cabrallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
RxStruct Gemma 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LZ
lzlv longLORA 70b rope8 32k
Lzlv · NanoByte
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WI
Wicked Love 12B
Wicked · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
RE
redpajama 3b chat
Redpajama · tensorblock
Params2.78B
Context5K
Smallest1.1 GB
GGUF
KU
kuno royale v3 7b
Kuno · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
MCES10/code-gen-gemma-2-2b-it
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
LL
BlackSheep Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TA
MN 12B Tarsus
Tarsus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MA
marquito
Marquito · abrar360
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CO
cognitivecomputations laserxtral
Cognitivecomputations · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CO
core 3 kuno royale v3 7b
Core · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CO
Command A 111B Animus V12.0
Command · Darkhn-Quants-2
Params111B
Context128K
Q4_K_M67.1 GB
RoleplayTool use
QW
QURSE browser demo
Qwen · woollyone
Params752M
Context64K
Smallest1.5 GB
Vision
LZ
lzlv 70B
Lzlv · lizpreciatior
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LO
Loquace 410m
Loquace · antoste
Params405M
Context2K
Smallest0.4 GB
GGUF
LO
Loquace 7B Q3 K L
Loquace · antoste
Params7.22B
Context2K
Smallest4.4 GB
GGUF
LA
laserxtral
Laserxtral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
QW
Qwen3 0.6B Sr Instruct
Qwen · Sagicc
Params596M
Context40K
Smallest0.6 GB
GGUF
LL
Ko En Llama2 13b
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF

Keep browsing