GGUF models by qwp4w3hyb
67 GGUF models quantized by qwp4w3hyb on Hugging Face. Sizes run from 1B to 236B parameters. The longest trained context is 1024K tokens.
About qwp4w3hyb on Hugging Face
qwp4w3hyb has published 67 GGUF models that ggufmodels.com tracks, across families such as Llama, Qwen and Mistral. The most downloaded are Meta-Llama-3-8B-Instruct, Starling LM 7B beta iMat and c4ai-command-r-v01.
The quants qwp4w3hyb publishes most often are IQ4_XS (66), IQ1_S (65), Q6_K (62) and Q4_K_M (62). Their Q4_K_M files range from 0.8 to 85.6 GB. Parameter counts run from 1B to 236B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has qwp4w3hyb published?
67 models are listed here, mainly from the Llama, Qwen and Mistral families. The most downloaded is Meta-Llama-3-8B-Instruct.
Which quants does qwp4w3hyb publish?
The most common are IQ4_XS (66 models), IQ1_S (65 models), Q6_K (62 models) and Q4_K_M (62 models).