GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LDCC Instruct Llama 2 Ko 13B v4.2.8
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
AI
Airoboros 33b Gpt4 1.4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest39.5 GB
GGUF
NY
Nyxene v1 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 8B Instruct DADA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LO
chargoddard_loyal-piano-m7
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b R
Xlam · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EU
L3.1 70B Euryale v2.2
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GI
giraffe176 Starling Monarch Westlake Garten 7B v0.1
Giraffe · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
aya-23-35B
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Empati v3
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 2M Instruct i1
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
AT
Athnete 13B
Athnete · IkariDev
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XL
xLAM 8x7b R
Xlam · gaianet
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
SN
SniffyOtter 7B Novel Writing NSFW
Sniffyotter · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
badger-lambda-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UN
UndiMix v1 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AY
Aya Empati v2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
CR
Creative Writer v0.2 Bravo 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
AI
Airoboros 13b Gpt4 1.1
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
PS
PsyMedRP v1 20B i1
Psymedrp · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Starcannon Unleashed 12B v1.0
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AR
Arsenic Shahrazad 12B v4.5
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GU
GutenOCR 3B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
BR
Brunhilde 13b
Brunhilde · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
PE
PersianLLaMA 13B
Persianllama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
DP
DPOB INMTOB 7B
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
kukulemon 7B i1
Kukulemon · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing