GGUF models: cc-by-nc-4.0 license
5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.
TO
Torchcast Decision 12b
Torchcast · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ST
StartLux Decision v1 4B Q8 0
Startlux · startlux-models
Params4.21B
Context256K
Smallest4.5 GB
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ST
StartLux Decision v1 27B Q4 K M
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
ST
StartLux Decision v1 9B Q4 K M
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
ST
StartLux-Decision-v1.1-9B-Instant
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
OP
openjev
Openjev · openjev
Params27B
Context256K
Q4_K_M16.5 GB
ST
berkeley-nest_starling-lm-7b-alpha
Starling · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
KI
MythoMax L2 Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Smallest1.6 GB
YU
quantized-yue2-3b
Yue · ngquocvinh
Params3.63B
Context—
Q4_K_M2.9 GB
PH
phonon 40m en
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
HE
Hemmingway 1 Heretic MTP V3 Vision
Hemmingway · brainnxdomain
Params27B
Context256K
Q4_K_M16.5 GB
PH
phonon 40m fr
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
ST
StartLux Decision v1 27B BF16
Startlux · startlux-models
Params27B
Context256K
Smallest53.8 GB
PH
phonon 40m pt
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
AY
Aya Expanse 8b
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
JI
Jina Embeddings v5 Text Small Classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hemmingway 1 Heretic With Mtp Bf16
Hemmingway · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
JI
Jina Embeddings v5 Text Small Text Matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
ST
StartLux Decision v1 4B Q4 K M
Startlux · startlux-models
Params4.21B
Context256K
Q4_K_M2.7 GB
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
EU
L3.1 70B Euryale v2.2
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB