GGUF models by yamatazen
46 GGUF models quantized by yamatazen on Hugging Face. Sizes run from 4.02B to 23.6B parameters. The longest trained context is 1000K tokens.
IR
Iris Light 12B Q4 K M
Iris · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
SN
SnowElf 12B v2
Snowelf · yamatazen
Params12.2B
Context128K
Q4_K_M7.5 GB
ET
EtherealAurora 12B Q4 K M
Etherealaurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GO
L3 GothicMaid 8B Q4 K M
Gothicmaid · yamatazen
Params8.03B
Context8K
Q4_K_M4.9 GB
EE
EerieLight 21B Q4 K M
Eerielight · yamatazen
Params20.4B
Context1000K
Q4_K_M12.4 GB
EL
ElvenMaid 12B Stock
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
FL
FlickeringLight 14B Q4 K M
Flickeringlight · yamatazen
Params14.4B
Context1000K
Q4_K_M8.8 GB
IR
Irida SCE 9B Q4 K M
Irida · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
ET
EtherealAurora 16B Q4 K M
Etherealaurora · yamatazen
Params16.1B
Context1000K
Q4_K_M9.7 GB
SH
Shirayuki SCE 9B Q4 K M
Shirayuki · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
HM
HMS Slerp 12B
Hms · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
AU
Aurora SCE 12B v2 Q4 K M
Aurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
ET
EtherealAurora 12B
Etherealaurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
EL
ElvenMaid 12B Q4 K M
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma2 BlueMoon 9B
Gemma · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
EL
ElvenMaid 12B v2
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB