GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
EM
Emerhyst 20B i1
Emerhyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
MI
Mixtral 13Bx2 MOE 22B i1
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
HA
TD HallOumi 3B
Halloumi · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
DR
Dragonwar 7b Alpha
Dragonwar · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
CohereLabs.tiny Aya Water
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
TH
L3.1 TheGreenLion 8b SFT v0.1.2
Thegreenlion · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SaoRPM-2x8B
Saorpm · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
LL
L3.1 8B Llamoutcast i1
Llamoutcast · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DP
DPOB NMTOB 7B i1
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AC
AceMath-1.5B-Instruct
Acemath · Mungert
Params1.78B
Context4K
Q4_K_M1.2 GB
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TI
Tiny Aya Earth
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
CA
Camel Platypus2 70B
Camel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
RE
ReMM v2.1 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
Starling LM alpha 8x7B MoE
Starling · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AL
AlphaMist7B Slr v1
Alphamist · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyAgent 7B
Tinyagent · QuantFactory
Params8.03B
Context10K
Q4_K_M4.9 GB
GP
HyperClassifier Gpt Oss 20b Qat 0226 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GM
GME VARCO VISION Embedding
Gme · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
OU
OuteTTS 0.3 1B
Outetts · second-state
Params1.19B
Context4K
Q4_K_M0.7 GB
EM
Emerhyst 20B
Emerhyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
NI
Ninja v1 RP expressive
Ninja · Aratako
Params7.24B
Context4K
Q4_K_M4.4 GB
AY
Aya Expanse 32b
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
seyf1elislam WestKunai Hermes 7b
Seyf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
Lila 70B L2
Lila · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CA
CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B
Cata · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB