GGUF models by qwp4w3hyb
67 GGUF models quantized by qwp4w3hyb on Hugging Face. Sizes run from 1B to 236B parameters. The longest trained context is 1024K tokens.
LL
Hermes-2-Theta-Llama-3-8B
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen1.5 14B Chat iMat
Qwen · qwp4w3hyb
Params14.2B
Context32K
Q4_K_M9.2 GB
QW
Qwen1.5 4B Chat iMat
Qwen · qwp4w3hyb
Params3.95B
Context32K
Q4_K_M2.5 GB
QW
Qwen1.5 7B Chat iMat
Qwen · qwp4w3hyb
Params7.72B
Context32K
Q4_K_M4.8 GB
CE
Cerebrum 1.0 8x7b
Cerebrum · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
FU
functionary-small-v2.4
Functionary · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
FU
functionary-medium-v2.4
Functionary · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB