GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NO
Noromaid 13B v0.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
Nethena 20B
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
XL
xLAM 7b R
Xlam · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ST
StartLux-Decision-v1.1-2B-Instant
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
NO
Noromaid 13B v0.2
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
JI
jina ocr v1
Jina · ahmadw
Params2.93B
Context—
Q4_K_M2.0 GB
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
TH
TherapyLlama 8B v1 i1
Therapyllama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
NU
Nu 17b
mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
ST
StartLux Decision v1 2B Q8 0
Startlux · startlux-models
Params1.88B
Context256K
Smallest2.0 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · Lewdiculous
Params8B
Context32K
Q4_K_M4.9 GB
AC
AceInstruct 7B
Aceinstruct · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
JI
Jina Embeddings v5 Text Nano Clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · Sao10K
Params10.7B
Context4K
Q4_K_M6.5 GB
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
EL
electric mist 7b
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AG
L3.1 Aglow Vulca v0.1 8B i1
Aglow · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
MixtralOrochi8x7B Alt
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
ES
MN 12B Estrella v1 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB