GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DR
dragonwar 7b s1
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
NE
NeuraLake m7 7B
Neuralake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SanjiWatsuki Loyal Macaroni Maid 7B
Sanjiwatsuki · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
TI
Tiny Cowboy 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NE
Daredevil 7B
Neuraldaredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WI
Wiederchat 7b i1
Wiederchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Meerkat 8b v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-fantasy-writer-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
amami 357m ro
Magpie · surogate
Params286M
Context2K
Smallest0.1 GB
GGUF
FI
Sao10K/Fimbulvetr-11B-v2.1-16K
Fimbulvetr · featherless-ai-quants
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
LE
LewdMistral 7B 0.2 i1
Lewdmistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CU
cuckoo starling 32k 7B
Cuckoo · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
reader lm 0.5b
Reader · mradermacher
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
AI
Airoboros 33b Gpt4 1.3
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · gaianet
Params1.19B
Context4K
Q4_K_M0.7 GB
GGUF
GU
GutenOCR 3B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LE
Legal Embedding Ita 0.6B
Legal · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
CO
Command R 35b Writer v3
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
HW
hwkwon S SOLAR 10.7B v1.2
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MO
Monika 31B
Monika · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
AY
Aya Enes B4
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NM
NMTOB 7B
Nmtob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3SOME 8B v2
Llama · BeaverLegacy
Params8B
Context10K
Q4_K_M4.9 GB
GGUF
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
RO
RoGemma2 9b Instruct DPO 2024 10 09
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KO
KoSOLAR v0.2 gugutypus 10.7B
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
GU
Guru 32B
Guru · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
TE
Tev 320B Uncensored Project Maya
Tev · QuantaPlanta
Params321B
Context1024K
Smallest118.4 GB
ReasoningTool use

Keep browsing