GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
EM
Emerhyst 20B i1
Emerhyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
MI
Mixtral 13Bx2 MOE 22B i1
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
HA
TD HallOumi 3B
Halloumi · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
DR
Dragonwar 7b Alpha
Dragonwar · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
CohereLabs.tiny Aya Water
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
TH
L3.1 TheGreenLion 8b SFT v0.1.2
Thegreenlion · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SaoRPM-2x8B
Saorpm · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Roleplay
LL
L3.1 8B Llamoutcast i1
Llamoutcast · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DP
DPOB NMTOB 7B i1
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
AceMath-1.5B-Instruct
Acemath · Mungert
Params1.78B
Context4K
Q4_K_M1.2 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TI
Tiny Aya Earth
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
CA
Camel Platypus2 70B
Camel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
RE
ReMM v2.1 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Starling LM alpha 8x7B MoE
Starling · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AL
AlphaMist7B Slr v1
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyAgent 7B
Tinyagent · QuantFactory
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
GP
HyperClassifier Gpt Oss 20b Qat 0226 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
GM
GME VARCO VISION Embedding
Gme · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
EmbeddingVision
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · second-state
Params1.19B
Context4K
Q4_K_M0.7 GB
GGUF
EM
Emerhyst 20B
Emerhyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
NI
Ninja v1 RP expressive
Ninja · Aratako
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
AY
Aya Expanse 32b
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SE
seyf1elislam WestKunai Hermes 7b
Seyf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LI
Lila 70B L2
Lila · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CA
CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B
Cata · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF

Keep browsing