GGUF models by 1bit-MONSTER

67 GGUF models quantized by 1bit-MONSTER on Hugging Face. Sizes run from 135M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi 2
Phi · 1bit-MONSTER
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
ZA
Zamba2 7B Instruct
Zamba · 1bit-MONSTER
Params11B
Context4K
Smallest11.7 GB
GGUF
QW
qwen2.5-14b-instruct
Qwen · 1bit-MONSTER
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
LF
LFM2.5 8B A1B
Lfm · 1bit-MONSTER
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
LL
Meta Llama 3.1 8B Instruct
Llama · 1bit-MONSTER
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 30B A3B
Qwen · 1bit-MONSTER
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
QW
qwen2.5-32b-instruct
Qwen · 1bit-MONSTER
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
OL
OLMo 2 0425 1B Instruct
OLMo · 1bit-MONSTER
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF

Keep browsing