GGUF models by 1bit-MONSTER
67 GGUF models quantized by 1bit-MONSTER on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 1024K tokens.
PH
phi 2
Phi · 1bit-MONSTER
Params2.78B
Context2K
Q4_K_M1.8 GB
ZA
Zamba2 7B Instruct
Zamba · 1bit-MONSTER
Params11B
Context4K
Smallest11.7 GB
QW
qwen2.5-14b-instruct
Qwen · 1bit-MONSTER
Params14.8B
Context128K
Q4_K_M9.0 GB
LF
LFM2.5 8B A1B
Lfm · 1bit-MONSTER
Params8.47B
Context125K
Q4_K_M5.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · 1bit-MONSTER
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 30B A3B
Qwen · 1bit-MONSTER
Params30.5B
Context40K
Q4_K_M18.6 GB
QW
qwen2.5-32b-instruct
Qwen · 1bit-MONSTER
Params32.8B
Context128K
Q4_K_M19.9 GB
OL
OLMo 2 0425 1B Instruct
OLMo · 1bit-MONSTER
Params1.48B
Context4K
Q4_K_M0.9 GB