GGUF models by Ransss
119 GGUF models quantized by Ransss on Hugging Face. Sizes run from 7.24B to 30.7B parameters. The longest trained context is 1000K tokens.
LL
Halu-8B-Llama3-Blackroot
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
DA
NS 12b DarkSluchCapV3
Darksluchcapv · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
LL
SOVLish-Devil-8B-L3
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
AB
L3.1 Ablaze Vulca v0.1 8B Q8 0
Ablaze · Ransss
Params8.03B
Context128K
Smallest8.5 GB
LY
Lyra Gutenbergs Twilight Magnum 12B Q8 0
Lyra · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
EC
Echidna-13b-v0.3
Echidna · Ransss
Params13B
Context4K
Smallest10.7 GB
KP
KPRA 7b Q8 0
Kpra · Ransss
Params7.24B
Context32K
Smallest7.7 GB
EP
MN Ephemeros 12B Q8 0
Ephemeros · Ransss
Params12.2B
Context128K
Smallest13.0 GB
DA
NS 12b DarkSlushCap
Darkslushcap · Ransss
Params12.2B
Context128K
Smallest13.0 GB
TH
L3-TheSpice-8b-v0.8.3
Thespice · Ransss
Params8.03B
Context8K
Smallest8.5 GB
LL
Pantheon-RP-1.0-8b-Llama-3
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
UL
Ultracore Instruct 12BV2
Ultracore · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · Ransss
Params8.03B
Context8K
Smallest8.5 GB
UN
L3-Uncen-Merger-Omelette-RP-v0.1.1-8B
Uncen · Ransss
Params8.03B
Context8K
Smallest8.5 GB
AN
AnotherOne Unslop Mell 12B Q8 0
Anotherone · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
YE
YetAnotherMerge v0.45 Q8 0
Yetanothermerge · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
NI
Ninja-v1-RP
Ninja · Ransss
Params7.24B
Context4K
Smallest7.7 GB
MI
Wayfarer Eris Noctis Mistralified 12B Q8 0
Mistral · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
FO
Forgotten Abomination 22B v4.0 Q6 K
Forgotten · Ransss
Params22.2B
Context128K
Smallest18.3 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · Ransss
Params12.2B
Context128K
Smallest13.0 GB
FO
Forgotten Safeword 24B v4.0 Q6 K
Forgotten · Ransss
Params23.6B
Context32K
Smallest19.3 GB
BE
BereavedCompound v1.0 24b
Bereavedcompound · Ransss
Params23.6B
Context128K
Smallest25.1 GB
TH
L3-TheSpice-8b-v0.1.3
Thespice · Ransss
Params8.03B
Context8K
Smallest8.5 GB
AU
Augmental-ReMM-13b-Merged
Augmental · Ransss
Params13B
Context4K
Smallest10.7 GB
EM
Emerald-13B
Emerald · Ransss
Params13B
Context4K
Smallest10.7 GB
MA
Magnolia V3B 12B
Magnolia · Ransss
Params12.2B
Context128K
Smallest13.0 GB
NO
Noromaid-13B-0.4-DPO
Noromaid · Ransss
Params13B
Context4K
Smallest13.8 GB
CE
Quantum-Citrus-9B
Cerebral · Ransss
Params8.99B
Context32K
Smallest9.6 GB
NE
Nemo 12b Humanize KTO Experimental Latest Q8 0
Nemo · Ransss
Params12.2B
Context128K
Smallest13.0 GB
TA
L3-8B-Tamamo-v1
Tamamo · Ransss
Params8.03B
Context8K
Smallest8.5 GB