GGUF models by SzilviaB
87 GGUF models quantized by SzilviaB on Hugging Face. Sizes run from 5.94B to 38.7B parameters. The longest trained context is 1000K tokens.
AL
Alignment Model Test3
Alignment · SzilviaB
Params21.4B
Context32K
Smallest22.8 GB
MA
Magnum Backyard Party 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
ME
mergekit slerp epibiuy Q3 K M
Mergekit · SzilviaB
Params34.4B
Context4K
Smallest16.7 GB
LY
Lyra Dark Mad Party 12b Q8 0
Lyra · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
ES
EstopianMaid 13B Q5 K M
Estopianmaid · SzilviaB
Params13B
Context4K
Smallest9.2 GB
IN
Ko 7b Ins
Ins · SzilviaB
Params6.86B
Context2K
Smallest7.3 GB
BE
BeAIhomiemaid DPO 12B v1
Beaihomiemaid · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
ME
mergekit slerp sqglozs Q4 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Q4_K_M20.7 GB
TI
TimeCrystal l2 13B Q5 K M
Timecrystal · SzilviaB
Params13B
Context4K
Smallest9.2 GB
SU
SuperDarkUnholyNeuralDaredevil 8b Q8 0
Superdarkunholyneuraldaredevil · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB
FI
Finch Truthy Dpo
Finch · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
DA
DarkNeuralDaredevilUnholy 8b Q8 0
Darkneuraldaredevilunholy · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB
NE
NeMoe Q4 K M
Nemoe · SzilviaB
Params21.1B
Context1000K
Q4_K_M12.8 GB
IN
Infinite_Shoggoth_Delirium_9B
Infinite · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
XW
Xwin Forest Q8 0
Xwin · SzilviaB
Params20B
Context4K
Smallest21.2 GB
SU
SuperDarkUnholyNeuralDaredevil 8b Q4 K M
Superdarkunholyneuraldaredevil · SzilviaB
Params8.03B
Context8K
Q4_K_M4.9 GB
NA
Naberius Trismegistus 7B Q8 0
Naberius · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
ME
mergekit slerp sqglozs Q3 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Smallest16.7 GB
GE
Gemma_Delirium_Rewired_9B
Gemma · SzilviaB
Params9.24B
Context8K
Smallest9.8 GB
TR
SOLAR 2x10.7b Truthy Dpo
Triple · SzilviaB
Params19.2B
Context4K
Smallest20.4 GB
MA
Magnum Lyra Darkness 12b Q8 0
Magnum · SzilviaB
Params12.2B
Context1000K
Smallest13.0 GB
TR
SOLAR 2x10.7b Truthy Dpo
Triple · SzilviaB
Params19.2B
Context4K
Smallest13.6 GB
EX
Exodia 7B
Exodia · SzilviaB
Params7.24B
Context32K
Smallest7.7 GB
AL
Alignment_Model_Test
Alignment · SzilviaB
Params21.4B
Context32K
Smallest22.8 GB
GE
Gemma_Delirium_Rewired_9B
Gemma · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
SH
Shoggoth_Delirium_9B
Shoggoth · SzilviaB
Params9.24B
Context8K
Smallest6.6 GB
DA
DarkNeuralDareDevil Eight Orbs Of Power 8b Q8 0
Darkneuraldaredevil · SzilviaB
Params8.03B
Context8K
Smallest8.5 GB