GGUF models by Reiterate3680

37 GGUF models quantized by Reiterate3680 on Hugging Face. Sizes run from 7.62B to 70.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NemoMix 12B DellaV1b
Nemomix · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
NE
nemo 12b hiwaifu
Nemo · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LO
MN LooseCannon 12B v2 Step1
Loosecannon · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LU
LumiHathor
Lumihathor · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
MN 12b Rosier v1
Rosier · Reiterate3680
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
YE
YetAnotherMerge v0.45
Yetanothermerge · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF

Keep browsing