GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
WE
WestIceLemonTeaRP 32k 7b i1
Westicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
reader lm 0.5b
Reader · bartowski
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
KA
Kaiju 11B
Kaiju · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
Tiny Aya Fire
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
CO
Command R 35b Writer v3
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
HA
Hala 1.2B
Hala · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
MI
Mistral 24b Reddit Writing v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
NE
Nethena 20B Glued
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
NI
Ninja v1 RP expressive breadcrumbs
Ninja · Aratako
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
ST
L3 8B Stheno v3.2 MPOA i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CL
undi95_clover3-17b
Clover · TheBloke
Params16.8B
Context32K
Q4_K_M10.1 GB
GGUF
MI
Mixtral Instruct ITR 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AI
Airoboros 13b Gpt4 1.4
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
IC
IceAbsintheLoucheV2RP 7b
Iceabsinthelouchev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MN 12B Mimicore Orochi i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
IN
Yi Ko 6B
Instruct · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
SW
SWIM 7B
Swim · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LL
LLaMA2-13B-Estopia
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
RE
ReaderLM v2
Readerlm · mradermacher
Params1.78B
Context501K
Q4_K_M1.1 GB
GGUF
RO
RoLlama3 8b Instruct 2024 06 28 i1
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UR
Urllm Ko 7b
Urllm · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
CA
Camel Platypus2 70B
Camel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IC
IceDrunkenCherryRP 7b i1
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
Loyal Toppy Bruins Maid 7B DARE GGUF Imatrix
Loyal · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
badger lambda llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing