GGUF models by qwp4w3hyb

67 GGUF models quantized by qwp4w3hyb on Hugging Face. Sizes run from 1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes-2-Theta-Llama-3-8B
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen1.5 14B Chat iMat
Qwen · qwp4w3hyb
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
QW
Qwen1.5 4B Chat iMat
Qwen · qwp4w3hyb
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
QW
Qwen1.5 7B Chat iMat
Qwen · qwp4w3hyb
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
CE
Cerebrum 1.0 8x7b
Cerebrum · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
FU
functionary-small-v2.4
Functionary · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
FU
functionary-medium-v2.4
Functionary · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use

Keep browsing