GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
WE
WestIceLemonTeaRP 32k 7b i1
Westicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 0.5b
Reader · bartowski
Params494M
Context250K
Q4_K_M0.4 GB
KA
Kaiju 11B
Kaiju · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
Tiny Aya Fire
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
CO
Command R 35b Writer v3
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
HA
Hala 1.2B
Hala · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
Mistral 24b Reddit Writing v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
NE
Nethena 20B Glued
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
NI
Ninja v1 RP expressive breadcrumbs
Ninja · Aratako
Params7.24B
Context4K
Q4_K_M4.4 GB
ST
L3 8B Stheno v3.2 MPOA i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CL
undi95_clover3-17b
Clover · TheBloke
Params16.8B
Context32K
Q4_K_M10.1 GB
MI
Mixtral Instruct ITR 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AI
Airoboros 13b Gpt4 1.4
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
IC
IceAbsintheLoucheV2RP 7b
Iceabsinthelouchev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MN 12B Mimicore Orochi i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
IN
Yi Ko 6B
Instruct · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
SW
SWIM 7B
Swim · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
LLaMA2-13B-Estopia
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LU
Lumimaid v0.2 8B
Lumimaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
RE
ReaderLM v2
Readerlm · mradermacher
Params1.78B
Context501K
Q4_K_M1.1 GB
RO
RoLlama3 8b Instruct 2024 06 28 i1
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
UR
Urllm Ko 7b
Urllm · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
CA
Camel Platypus2 70B
Camel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IC
IceDrunkenCherryRP 7b i1
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
Loyal Toppy Bruins Maid 7B DARE GGUF Imatrix
Loyal · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB