GGUF models: cc-by-nc-2.0 license
74 GGUF models listed under the cc-by-nc-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 69M to 120B parameters. The longest trained context is 1000K tokens.
BL
BlackSheep 24B
Blacksheep · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
TA
MN 12B Tarsus iMat
Tarsus · Quant-Cartel
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
Cabra 72b
Cabra · mradermacher
Params72.3B
Context32K
Q4_K_M44.1 GB
TA
MN 12B Tarsus i1
Tarsus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
Command A 111B Animus V13.0
Command · Darkhn-Quants-3
Params111B
Context128K
Q4_K_M67.1 GB
LA
laserxtral
Laserxtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
SA
Sanskrit Translate V1.0
Sanskrit · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
FINETUNED MEDICAL LLAMA 7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
TR
TriFusionNexus 7b
Trifusionnexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
botbot-ai/CabraLlama3-8b
Cabrallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
RxStruct Gemma 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LZ
lzlv longLORA 70b rope8 32k
Lzlv · NanoByte
Params69B
Context4K
Q4_K_M41.4 GB
WI
Wicked Love 12B
Wicked · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RE
redpajama 3b chat
Redpajama · tensorblock
Params2.78B
Context5K
Smallest1.1 GB
KU
kuno royale v3 7b
Kuno · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GE
MCES10/code-gen-gemma-2-2b-it
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
BlackSheep Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
TA
MN 12B Tarsus
Tarsus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
marquito
Marquito · abrar360
Params3.21B
Context128K
Q4_K_M2.0 GB
CO
cognitivecomputations laserxtral
Cognitivecomputations · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
CO
core 3 kuno royale v3 7b
Core · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
CO
Command A 111B Animus V12.0
Command · Darkhn-Quants-2
Params111B
Context128K
Q4_K_M67.1 GB
QW
QURSE browser demo
Qwen · woollyone
Params752M
Context64K
Smallest1.5 GB
LZ
lzlv 70B
Lzlv · lizpreciatior
Params69B
Context4K
Q4_K_M41.4 GB
LO
Loquace 410m
Loquace · antoste
Params405M
Context2K
Smallest0.4 GB
LO
Loquace 7B Q3 K L
Loquace · antoste
Params7.22B
Context2K
Smallest4.4 GB
LA
laserxtral
Laserxtral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
QW
Qwen3 0.6B Sr Instruct
Qwen · Sagicc
Params596M
Context40K
Smallest0.6 GB
LL
Ko En Llama2 13b
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB