GGUF models by Reiterate3680
37 GGUF models quantized by Reiterate3680 on Hugging Face. Sizes run from 7.62B to 70.6B parameters. The longest trained context is 1000K tokens.
NE
NemoMix 12B DellaV1b
Nemomix · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
MA
Magnum 12b v2.5 Kto
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
NE
nemo 12b hiwaifu
Nemo · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
LO
MN LooseCannon 12B v2 Step1
Loosecannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
LU
LumiHathor
Lumihathor · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
MN 12b Rosier v1
Rosier · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
YE
YetAnotherMerge v0.45
Yetanothermerge · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB