GGUF models by SzilviaB

87 GGUF models quantized by SzilviaB on Hugging Face. Sizes run from 5.94B to 38.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
Alignment Model Test3
Alignment · SzilviaB
Params21.4B
Context32K
Smallest22.8 GB
GGUF
MA
Magnum Backyard Party 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
ME
mergekit slerp epibiuy Q3 K M
Mergekit · SzilviaB
Params34.4B
Context4K
Smallest16.7 GB
GGUF
LY
Lyra Dark Mad Party 12b Q8 0
Lyra · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
ES
EstopianMaid 13B Q5 K M
Estopianmaid · SzilviaB
Params13B
Context4K
Smallest9.2 GB
Roleplay
IN
Ko 7b Ins
Ins · SzilviaB
Params6.86B
Context2K
Smallest7.3 GB
GGUF
BE
BeAIhomiemaid DPO 12B v1
Beaihomiemaid · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Roleplay
ME
mergekit slerp sqglozs Q4 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
TI
TimeCrystal l2 13B Q5 K M
Timecrystal · SzilviaB
Params13B
Context4K
Smallest9.2 GB
Roleplay
SU
SuperDarkUnholyNeuralDaredevil 8b Q8 0
Superdarkunholyneuraldaredevil · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB
GGUF
FI
Finch Truthy Dpo
Finch · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
GGUF
DA
DarkNeuralDaredevilUnholy 8b Q8 0
Darkneuraldaredevilunholy · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB
GGUF
NE
NeMoe Q4 K M
Nemoe · SzilviaB
Params21.1B
Context1000K
Q4_K_M12.8 GB
GGUF
IN
Infinite_Shoggoth_Delirium_9B
Infinite · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
GGUF
XW
Xwin Forest Q8 0
Xwin · SzilviaB
Params20B
Context4K
Smallest21.2 GB
GGUF
SU
SuperDarkUnholyNeuralDaredevil 8b Q4 K M
Superdarkunholyneuraldaredevil · SzilviaB
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NA
Naberius Trismegistus 7B Q8 0
Naberius · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ME
mergekit slerp sqglozs Q3 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Smallest16.7 GB
GGUF
GE
Gemma_Delirium_Rewired_9B
Gemma · SzilviaB
Params9.24B
Context8K
Smallest9.8 GB
GGUF
TR
SOLAR 2x10.7b Truthy Dpo
Triple · SzilviaB
Params19.2B
Context4K
Smallest20.4 GB
GGUF
MA
Magnum Lyra Darkness 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
TR
SOLAR 2x10.7b Truthy Dpo
Triple · SzilviaB
Params19.2B
Context4K
Smallest13.6 GB
GGUF
EX
Exodia 7B
Exodia · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
GGUF
AL
Alignment_Model_Test
Alignment · SzilviaB
Params21.4B
Context32K
Smallest22.8 GB
GGUF
GE
Gemma_Delirium_Rewired_9B
Gemma · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
GGUF
SH
Shoggoth_Delirium_9B
Shoggoth · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
GGUF
DA
DarkNeuralDareDevil Eight Orbs Of Power 8b Q8 0
Darkneuraldaredevil · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB
GGUF

Keep browsing