GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AY
aya-23-8B
Aya · mmnga
Params8.03B
Context8K
Q4_K_M5.1 GB
LL
badger lambda llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
Moistral 11B v2.1b SOGGY
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.6 GB
AI
Airoboros 7b Gpt4 1.2
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
YI
Fook-Yi-34B-32K-v1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
SP
Spaetzle v65 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
KnutJaegersberg Deacon 13b
Deacon · tensorblock
Params13B
Context8K
Smallest4.9 GB
OU
OuteTTS 0.2 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
OC
Octen WebGR 0.6B Gundem LoRA
Octen · efebaykara
Params730M
Context32K
Q4_K_M0.5 GB
ST
StartLux Decision v1 0.8B BF16
Startlux · startlux-models
Params752M
Context256K
Smallest1.5 GB
LL
grimjim llama 3 merge avalon 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceSakeRP-7b
Icesakerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
Unbabel TowerBase 7B v0.1
Towerbase · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MO
Monika 31B
Monika · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Mistral RP 0.1 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
LL
badger lambda llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LY
v000000 NM 12B Lyris dev 3
Lyris · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
CR
Creative Writer 32b Preview
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
YI
Hyeogi Yi 9b v1
Yi · tensorblock
Params8.95B
Context2K
Smallest3.4 GB
ZO
Zombiellm
Zombiellm · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
CH
ChocoLlama ChocoLlama 2 7B instruct
Chocollama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
TE
T.E 8.1 GGUF IQ Imatrix Request
Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
PA
Fritter v1.0 (Parakeet TDT 0.6B v2, English dictation)
Parakeet · danielrosehill
Params618M
Context—
Q4_K_M0.5 GB
PE
PetrolWriter-7B
Petrolwriter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10.7B v1.2
Solar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.05 Nemotron Tenyxchat Storybreaker 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
IT
ITT Yi Ko 6B v6.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
CA
Eric111/CatunaLaserPi-DPO
Catunalaserpi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
icefog72/WestIceLemonTeaRP-32k-7b
Westicelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
paulml NMTOB 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB