GGUF models by ddh0
65 GGUF models quantized by ddh0 on Hugging Face. Sizes run from 14M to 549B parameters. The longest trained context is 1024K tokens.
ZE
zephyr 7b beta GGUF fp16
Zephyr · ddh0
Params7.24B
Context32K
Smallest14.5 GB
QW
Qwen3.5-27B-Writer
Qwen · ddh0
Params26.9B
Context256K
Smallest18.3 GB
LL
Llama 13b
Llama · ddh0
Params13B
Context2K
Smallest13.8 GB
MI
MiniMax-M2.5
Minimax · ddh0
Params229B
Context192K
Smallest123.8 GB
MI
Mixtral-8x7B-Instruct-v0.1
Mistral · ddh0
Params46.7B
Context32K
Smallest49.6 GB
GL
GLM Steam 106B A12B v1b Q8 0
GLM · ddh0
Params110B
Context128K
Smallest117.5 GB
GE
Gemma 4 Dark Orithia Untied 31B
Gemma · ddh0
Params32.1B
Context256K
Smallest14.4 GB