GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
DR
dragonwar 7b s1
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
NE
NeuraLake m7 7B
Neuralake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SanjiWatsuki Loyal Macaroni Maid 7B
Sanjiwatsuki · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
TI
Tiny Cowboy 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
NE
Daredevil 7B
Neuraldaredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
WI
Wiederchat 7b i1
Wiederchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Meerkat 8b v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-fantasy-writer-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
amami 357m ro
Magpie · surogate
Params286M
Context2K
Smallest0.1 GB
FI
Sao10K/Fimbulvetr-11B-v2.1-16K
Fimbulvetr · featherless-ai-quants
Params10.7B
Context16K
Q4_K_M6.5 GB
LE
LewdMistral 7B 0.2 i1
Lewdmistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CU
cuckoo starling 32k 7B
Cuckoo · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 0.5b
Reader · mradermacher
Params494M
Context250K
Q4_K_M0.4 GB
AI
Airoboros 33b Gpt4 1.3
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
OU
OuteTTS 0.3 1B
Outetts · gaianet
Params1.19B
Context4K
Q4_K_M0.7 GB
GU
GutenOCR 3B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
LE
Legal Embedding Ita 0.6B
Legal · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
CO
Command R 35b Writer v3
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
HW
hwkwon S SOLAR 10.7B v1.2
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
MO
Monika 31B
Monika · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
AY
Aya Enes B4
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
NM
NMTOB 7B
Nmtob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3SOME 8B v2
Llama · BeaverLegacy
Params8B
Context10K
Q4_K_M4.9 GB
HO
Holo1.5 72B
Holo · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
RO
RoGemma2 9b Instruct DPO 2024 10 09
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
KO
KoSOLAR v0.2 gugutypus 10.7B
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GU
Guru 32B
Guru · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
TE
Tev 320B Uncensored Project Maya
Tev · QuantaPlanta
Params321B
Context1024K
Smallest118.4 GB