GGUF models by Ransss

119 GGUF models quantized by Ransss on Hugging Face. Sizes run from 7.24B to 30.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
kukuspice 7B Q8 0
Thespice · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
CA
Captain Eris Noctis 12B v0.420 Q8 0
Captain · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
ME
Mergedonia PROMETHEUS 24B v1
Mergedonia · Ransss
Params23.6B
Context128K
Smallest25.1 GB
GGUF
SN
Kuro-Lotus-10.7B
Snowlotus · Ransss
Params10.7B
Context8K
Smallest11.4 GB
GGUF
SQ
Squelching Fantasies Qw3 14B
Squelching · Ransss
Params14B
Context40K
Smallest15.7 GB
Roleplay
TR
Trouper 12B
Trouper · Ransss
Params12.2B
Context128K
Smallest13.0 GB
Roleplay
NE
Nemo 12b Humanize KTO Experimental Latest B Q8 0
Nemo · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
SP
Spring_24B_V.5
Spring · Ransss
Params23.6B
Context128K
Smallest25.1 GB
Roleplay
DA
DarkSapling-7B-v2.0
Darksapling · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
CA
Captain Eris BMO Violent GRPO v0.420 Q8 0
Captain · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
EC
Eclectic-Maid-10B-v3
Eclectic · Ransss
Params10.7B
Context32K
Smallest11.4 GB
GGUF
MY
Mystic Rune v2 12B
Mystic · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
SM
Smoothie 12B Model_Stock
Smoothie · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
XW
Xwin-MLewd-13B-V0.2
Xwin · Ransss
Params13B
Context4K
Smallest13.8 GB
GGUF
SH
Shadow Crystal 12B
Shadow · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
LL
llama-3-Stheno-Mahou-8B
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Captain Eris Twilight Mistralified 12B Q8 0
Mistral · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
MO
Moonlit Shadow 12B
Moonlit · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
MI
Mistral-7B-Erebus-v3
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MA
Magnolia v4 12B
Magnolia · Ransss
Params12.2B
Context128K
Smallest13.0 GB
GGUF
KA
Kaiden Sakura Violet Square Azura crimson 12B Q8 0
Kaiden · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
LL
llama-3-Daredevil-Mahou-8B
Llama · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF
LY
Lyralin 12B v1 Q8 0
Lyralin · Ransss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
AM
Amethyst-13B
Amethyst · Ransss
Params13B
Context4K
Smallest10.7 GB
GGUF
MI
flammen24 mistral 7B Q8 0
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ST
L3-SthenoMaidBlackroot-15B
Sthenomaidblackroot · Ransss
Params15B
Context8K
Smallest12.3 GB
GGUF
MI
flammen24X-mistral-7B
Mistral · Ransss
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ES
EstopianMaid-13B
Estopianmaid · Ransss
Params13B
Context4K
Smallest10.7 GB
Roleplay
IN
L3.1 8b RP Ink Q8 0
Ink · Ransss
Params8.03B
Context128K
Smallest8.5 GB
RoleplayTool use
DO
Domain-Fusion-L3-8B
Domain · Ransss
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing