GGUF models by jacobcarajo
55 GGUF models quantized by jacobcarajo on Hugging Face. Sizes run from 494M to 34.7B parameters. The longest trained context is 256K tokens.
About jacobcarajo on Hugging Face
jacobcarajo has published 55 GGUF models that ggufmodels.com tracks, across families such as Qwen, Mistral and Llama. The most downloaded are DeepSeek R1 Distill Qwen 14B, Qwen3 Coder 30B A3B Instruct and dolphin 2.9.4 llama3.1 8b Q5 K M.
The quants jacobcarajo publishes most often are Q5_K_M (51), Q4_K_M (2), Q8_0 (1) and BF16 (1). Their Q4_K_M files range from 0.4 to 4.9 GB. Parameter counts run from 494M to 34.7B, and the longest trained context window is 256K tokens.
Frequently asked questions
What GGUF models has jacobcarajo published?
55 models are listed here, mainly from the Qwen, Mistral and Llama families. The most downloaded is DeepSeek R1 Distill Qwen 14B.
Which quants does jacobcarajo publish?
The most common are Q5_K_M (51 models), Q4_K_M (2 models), Q8_0 (1 models) and BF16 (1 models).