GGUF models by Reiterate3680

37 GGUF models quantized by Reiterate3680 on Hugging Face. Sizes run from 7.62B to 70.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GU
guns and roses r1
Guns · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
LY
MN 12B Lyra v1
Lyra · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
Nemomix v4.0 12B
Nemomix · Reiterate3680
Params12.2B
Context1000K
Q4_K_M8.0 GB
GGUF
CL
L3.1 ClaudeMaid 4x8B
Claudemaid · Reiterate3680
Params24.9B
Context128K
Q4_K_M15.2 GB
GGUF
MI
Mini Magnum 12b v1.1
Mini · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SE
Sekhmet Gimmel L3.1 8B v0.3
Sekhmet · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HA
Hathor Sofit L3 8B v1
Hathor · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
HO
Hollow Tail V1 12B
Hollow · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
EU
L3.1 70B Euryale v2.2
Euryale · Reiterate3680
Params70.6B
Context128K
Smallest31.9 GB
GGUF
RO
Rocinante 12B v1b
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
HA
Hathor Trihexa L3 8B Anarchy Edition
Hathor · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF
MA
Magnum 12b v2
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
MN 12B Starcannon v2
Starcannon · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SO
Soliloquy 7B v3
Soliloquy · Reiterate3680
Params7.62B
Context32K
Smallest5.1 GB
GGUF
LY
MN 12B Lyra v3
Lyra · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AU
AuraFinal12B
Aurafinal · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
AU
Aura NeMo 12B
Aura · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
SU
L3 Super Nova RP 8B
Super · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SU
MN 12b Sunrose
Sunrose · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TA
MN 12B Tarsus
Tarsus · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
SE
Sekhmet_Aleph L3.1 8B v0.1
Sekhmet · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HE
L3 8B Helium3
Helium · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
MN 12B Starcannon v3
Starcannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
TU
Tuldur 8B
Tuldur · Reiterate3680
Params8.03B
Context128K
Smallest5.3 GB
GGUF
AZ
Azure Dusk v0.1
Azure · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
SA
L3 SAO MIX 8B V1
Sao · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF

About Reiterate3680 on Hugging Face

Reiterate3680 has published 37 GGUF models that ggufmodels.com tracks, across families such as Sekhmet, Starcannon and Rocinante. The most downloaded are guns and roses r1, MN 12B Lyra v1 and Nemomix v4.0 12B.

The quants Reiterate3680 publishes most often are Q4_K_L (30), Q6_K_L (28), Q6_K (16) and Q4_K_M (16). Their Q4_K_M files range from 4.9 to 15.2 GB. Parameter counts run from 7.62B to 70.6B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has Reiterate3680 published?

37 models are listed here, mainly from the Sekhmet, Starcannon and Rocinante families. The most downloaded is guns and roses r1.

Which quants does Reiterate3680 publish?

The most common are Q4_K_L (30 models), Q6_K_L (28 models), Q6_K (16 models) and Q4_K_M (16 models).

Keep browsing