GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
GGUF
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
NO
Noromaid 13B v0.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Nethena 20B
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
XL
xLAM 7b R
Xlam · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
StartLux-Decision-v1.1-2B-Instant
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
NO
Noromaid 13B v0.2
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JI
jina ocr v1
Jina · ahmadw
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
TH
TherapyLlama 8B v1 i1
Therapyllama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NU
Nu 17b
mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
Roleplay
ST
StartLux Decision v1 2B Q8 0
Startlux · startlux-models
Params1.88B
Context256K
Smallest2.0 GB
GGUF
ST
L3-8B-Stheno-v3.3-32K
Stheno · Lewdiculous
Params8B
Context32K
Q4_K_M4.9 GB
Roleplay
AC
AceInstruct 7B
Aceinstruct · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
JI
Jina Embeddings v5 Text Nano Clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
FI
Fimbulvetr 11B v2
Fimbulvetr · Sao10K
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
EL
electric mist 7b
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
AG
L3.1 Aglow Vulca v0.1 8B i1
Aglow · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MI
MixtralOrochi8x7B Alt
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
ES
MN 12B Estrella v1 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF

Keep browsing