GGUF models by Ransss

119 GGUF models quantized by Ransss on Hugging Face. Sizes run from 7.24B to 30.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Halu-8B-Llama3-Blackroot
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
DA
NS 12b DarkSluchCapV3
Darksluchcapv · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
LL
SOVLish-Devil-8B-L3
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
AB
L3.1 Ablaze Vulca v0.1 8B Q8 0
Ablaze · Ransss
Params8.03B
Context128K
Smallest8.5 GB
GGUF
LY
Lyra Gutenbergs Twilight Magnum 12B Q8 0
Lyra · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
EC
Echidna-13b-v0.3
Echidna · Ransss
Params13B
Context4K
Smallest10.7 GB
GGUF
KP
KPRA 7b Q8 0
Kpra · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
EP
MN Ephemeros 12B Q8 0
Ephemeros · Ransss
Params12.2B
Context128K
Smallest13.0 GB
Tool use
DA
NS 12b DarkSlushCap
Darkslushcap · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
TH
L3-TheSpice-8b-v0.8.3
Thespice · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LL
Pantheon-RP-1.0-8b-Llama-3
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
UL
Ultracore Instruct 12BV2
Ultracore · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
HA
Hathor_Stable-v0.2-L3-8B
Hathor · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
UN
L3-Uncen-Merger-Omelette-RP-v0.1.1-8B
Uncen · Ransss
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
AN
AnotherOne Unslop Mell 12B Q8 0
Anotherone · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
YE
YetAnotherMerge v0.45 Q8 0
Yetanothermerge · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
NI
Ninja-v1-RP
Ninja · Ransss
Params7.24B
Context4K
Smallest7.7 GB
Roleplay
MI
Wayfarer Eris Noctis Mistralified 12B Q8 0
Mistral · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
FO
Forgotten Abomination 22B v4.0 Q6 K
Forgotten · Ransss
Params22.2B
Context128K
Smallest18.3 GB
RoleplayTool use
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
FO
Forgotten Safeword 24B v4.0 Q6 K
Forgotten · Ransss
Params23.6B
Context32K
Smallest19.3 GB
Roleplay
BE
BereavedCompound v1.0 24b
Bereavedcompound · Ransss
Params23.6B
Context128K
Smallest25.1 GB
GGUF
TH
L3-TheSpice-8b-v0.1.3
Thespice · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AU
Augmental-ReMM-13b-Merged
Augmental · Ransss
Params13B
Context4K
Smallest10.7 GB
GGUF
EM
Emerald-13B
Emerald · Ransss
Params13B
Context4K
Smallest10.7 GB
GGUF
MA
Magnolia V3B 12B
Magnolia · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
NO
Noromaid-13B-0.4-DPO
Noromaid · Ransss
Params13B
Context4K
Smallest13.8 GB
GGUF
CE
Quantum-Citrus-9B
Cerebral · Ransss
Params8.99B
Context32K
Smallest9.6 GB
GGUF
NE
Nemo 12b Humanize KTO Experimental Latest Q8 0
Nemo · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
TA
L3-8B-Tamamo-v1
Tamamo · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing