GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
aya-23-8B
Aya · mmnga
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
badger lambda llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Moistral 11B v2.1b SOGGY
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.6 GB
GGUF
AI
Airoboros 7b Gpt4 1.2
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
SP
Spaetzle v65 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
KnutJaegersberg Deacon 13b
Deacon · tensorblock
Params13B
Context8K
Smallest4.9 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
OC
Octen WebGR 0.6B Gundem LoRA
Octen · efebaykara
Params730M
Context32K
Q4_K_M0.5 GB
ReasoningTool use
ST
StartLux Decision v1 0.8B BF16
Startlux · startlux-models
Params752M
Context256K
Smallest1.5 GB
ReasoningTool use
LL
grimjim llama 3 merge avalon 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
IceSakeRP-7b
Icesakerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
Unbabel TowerBase 7B v0.1
Towerbase · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MO
Monika 31B
Monika · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
MI
Mistral RP 0.1 7B
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
Roleplay
LL
badger lambda llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LY
v000000 NM 12B Lyris dev 3
Lyris · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CR
Creative Writer 32b Preview
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
YI
Hyeogi Yi 9b v1
Yi · tensorblock
Params8.95B
Context2K
Smallest3.4 GB
GGUF
ZO
Zombiellm
Zombiellm · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
CH
ChocoLlama ChocoLlama 2 7B instruct
Chocollama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
TE
T.E 8.1 GGUF IQ Imatrix Request
Lewdiculous
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
PA
Fritter v1.0 (Parakeet TDT 0.6B v2, English dictation)
Parakeet · danielrosehill
Params618M
Context—
Q4_K_M0.5 GB
GGUF
PE
PetrolWriter-7B
Petrolwriter · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10.7B v1.2
Solar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.05 Nemotron Tenyxchat Storybreaker 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
IT
ITT Yi Ko 6B v6.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
CA
Eric111/CatunaLaserPi-DPO
Catunalaserpi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
icefog72/WestIceLemonTeaRP-32k-7b
Westicelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
paulml NMTOB 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing