GGUF models by forkjoin-ai
53 GGUF models quantized by forkjoin-ai on Hugging Face. Sizes run from 362M to 72.7B parameters. The longest trained context is 1024K tokens.
About forkjoin-ai on Hugging Face
forkjoin-ai has published 53 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Gemma. The most downloaded are Qwen2 Audio 7B Instruct, loki erotica 8b and qwen2.5-7b-instruct.
The quants forkjoin-ai publishes most often are Q4_K_M (44), Q8_0 (9), Q4_K (2) and F16 (2). Their Q4_K_M files range from 0.3 to 47.4 GB. Parameter counts run from 362M to 72.7B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has forkjoin-ai published?
53 models are listed here, mainly from the Qwen, Llama and Gemma families. The most downloaded is Qwen2 Audio 7B Instruct.
Which quants does forkjoin-ai publish?
The most common are Q4_K_M (44 models), Q8_0 (9 models), Q4_K (2 models) and F16 (2 models).