GGUF models by yamatazen

46 GGUF models quantized by yamatazen on Hugging Face. Sizes run from 4.02B to 23.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
IR
Iris Light 12B Q4 K M
Iris · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SN
SnowElf 12B v2
Snowelf · yamatazen
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
ET
EtherealAurora 12B Q4 K M
Etherealaurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GO
L3 GothicMaid 8B Q4 K M
Gothicmaid · yamatazen
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EE
EerieLight 21B Q4 K M
Eerielight · yamatazen
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
EL
ElvenMaid 12B Stock
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FL
FlickeringLight 14B Q4 K M
Flickeringlight · yamatazen
Params14.4B
Context1000K
Q4_K_M8.8 GB
GGUF
IR
Irida SCE 9B Q4 K M
Irida · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ET
EtherealAurora 16B Q4 K M
Etherealaurora · yamatazen
Params16.1B
Context1000K
Q4_K_M9.7 GB
GGUF
SH
Shirayuki SCE 9B Q4 K M
Shirayuki · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HM
HMS Slerp 12B
Hms · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AU
Aurora SCE 12B v2 Q4 K M
Aurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ET
EtherealAurora 12B
Etherealaurora · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
EL
ElvenMaid 12B Q4 K M
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Gemma2 BlueMoon 9B
Gemma · yamatazen
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
EL
ElvenMaid 12B v2
Elvenmaid · yamatazen
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing