GGUF models: cc-by-nc-4.0 license

5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
Torchcast Decision 12b
Torchcast · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
ST
StartLux Decision v1 4B Q8 0
Startlux · startlux-models
Params4.21B
Context256K
Smallest4.5 GB
GGUF
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
ST
StartLux Decision v1 27B Q4 K M
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
ST
StartLux Decision v1 9B Q4 K M
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
ST
StartLux-Decision-v1.1-9B-Instant
Startlux · startlux-models
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
OP
openjev
Openjev · openjev
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
ST
berkeley-nest_starling-lm-7b-alpha
Starling · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
KI
MythoMax L2 Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Smallest1.6 GB
GGUF
YU
quantized-yue2-3b
Yue · ngquocvinh
Params3.63B
Context—
Q4_K_M2.9 GB
GGUF
PH
phonon 40m en
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
HE
Hemmingway 1 Heretic MTP V3 Vision
Hemmingway · brainnxdomain
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
PH
phonon 40m fr
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
ST
StartLux Decision v1 27B BF16
Startlux · startlux-models
Params27B
Context256K
Smallest53.8 GB
GGUF
PH
phonon 40m pt
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
AY
Aya Expanse 8b
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
JI
Jina Embeddings v5 Text Small Classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HE
Hemmingway 1 Heretic With Mtp Bf16
Hemmingway · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
JI
Jina Embeddings v5 Text Small Text Matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
Tool use
ST
StartLux Decision v1 4B Q4 K M
Startlux · startlux-models
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
EU
L3.1 70B Euryale v2.2
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing