GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
LDCC Instruct Llama 2 Ko 13B v4.2.8
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
AI
Airoboros 33b Gpt4 1.4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest39.5 GB
NY
Nyxene v1 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
Llama 3 8B Instruct DADA i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LO
chargoddard_loyal-piano-m7
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 7b R
Xlam · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
L3.1 70B Euryale v2.2
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GI
giraffe176 Starling Monarch Westlake Garten 7B v0.1
Giraffe · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
aya-23-35B
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
AY
Aya Empati v3
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
LL
Llama 3.1 Nemotron 8B UltraLong 2M Instruct i1
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
AT
Athnete 13B
Athnete · IkariDev
Params13B
Context4K
Q4_K_M7.9 GB
XL
xLAM 8x7b R
Xlam · gaianet
Params46.7B
Context32K
Q4_K_M28.4 GB
SN
SniffyOtter 7B Novel Writing NSFW
Sniffyotter · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
badger-lambda-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
UndiMix v1 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AY
Aya Empati v2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
CR
Creative Writer v0.2 Bravo 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
AI
Airoboros 13b Gpt4 1.1
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
PS
PsyMedRP v1 20B i1
Psymedrp · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Starcannon Unleashed 12B v1.0
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
AR
Arsenic Shahrazad 12B v4.5
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GU
GutenOCR 3B
Gutenocr · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
BR
Brunhilde 13b
Brunhilde · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PE
PersianLLaMA 13B
Persianllama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
DP
DPOB INMTOB 7B
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
kukulemon 7B i1
Kukulemon · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB