GGUF models by Ransss
119 GGUF models quantized by Ransss on Hugging Face. Sizes run from 7.24B to 30.7B parameters. The longest trained context is 1000K tokens.
TH
kukuspice 7B Q8 0
Thespice · Ransss
Params7.24B
Context32K
Smallest7.7 GB
CA
Captain Eris Noctis 12B v0.420 Q8 0
Captain · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
ME
Mergedonia PROMETHEUS 24B v1
Mergedonia · Ransss
Params23.6B
Context128K
Smallest25.1 GB
SN
Kuro-Lotus-10.7B
Snowlotus · Ransss
Params10.7B
Context8K
Smallest11.4 GB
SQ
Squelching Fantasies Qw3 14B
Squelching · Ransss
Params14B
Context40K
Smallest15.7 GB
TR
Trouper 12B
Trouper · Ransss
Params12.2B
Context128K
Smallest13.0 GB
NE
Nemo 12b Humanize KTO Experimental Latest B Q8 0
Nemo · Ransss
Params12.2B
Context128K
Smallest13.0 GB
SP
Spring_24B_V.5
Spring · Ransss
Params23.6B
Context128K
Smallest25.1 GB
DA
DarkSapling-7B-v2.0
Darksapling · Ransss
Params7.24B
Context32K
Smallest7.7 GB
CA
Captain Eris BMO Violent GRPO v0.420 Q8 0
Captain · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
EC
Eclectic-Maid-10B-v3
Eclectic · Ransss
Params10.7B
Context32K
Smallest11.4 GB
MY
Mystic Rune v2 12B
Mystic · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
SM
Smoothie 12B Model_Stock
Smoothie · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
XW
Xwin-MLewd-13B-V0.2
Xwin · Ransss
Params13B
Context4K
Smallest13.8 GB
SH
Shadow Crystal 12B
Shadow · Ransss
Params12.2B
Context128K
Smallest13.0 GB
LL
llama-3-Stheno-Mahou-8B
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
MI
Captain Eris Twilight Mistralified 12B Q8 0
Mistral · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
MO
Moonlit Shadow 12B
Moonlit · Ransss
Params12.2B
Context128K
Smallest13.0 GB
MI
Mistral-7B-Erebus-v3
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
MA
Magnolia v4 12B
Magnolia · Ransss
Params12.2B
Context128K
Smallest13.0 GB
KA
Kaiden Sakura Violet Square Azura crimson 12B Q8 0
Kaiden · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
LL
llama-3-Daredevil-Mahou-8B
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
LY
Lyralin 12B v1 Q8 0
Lyralin · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
AM
Amethyst-13B
Amethyst · Ransss
Params13B
Context4K
Smallest10.7 GB
MI
flammen24 mistral 7B Q8 0
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
ST
L3-SthenoMaidBlackroot-15B
Sthenomaidblackroot · Ransss
Params15B
Context8K
Smallest12.3 GB
MI
flammen24X-mistral-7B
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
ES
EstopianMaid-13B
Estopianmaid · Ransss
Params13B
Context4K
Smallest10.7 GB
IN
L3.1 8b RP Ink Q8 0
Ink · Ransss
Params8.03B
Context128K
Smallest8.5 GB
DO
Domain-Fusion-L3-8B
Domain · Ransss
Params8.03B
Context8K
Smallest8.5 GB