GGUF models by sinjab
55 GGUF models quantized by sinjab on Hugging Face. Sizes run from 4M to 7.57B parameters. The longest trained context is 40K tokens.
About sinjab on Hugging Face
sinjab has published 55 GGUF models that ggufmodels.com tracks, across families such as Marco, Qwen and Jina. The most downloaded are ms marco MiniLM L6 v2 Q8 0, Qwen3 Reranker 4B and bge reranker base Q8 0.
The quants sinjab publishes most often are F16 (19), Q8_0 (18) and Q4_K_M (18). Their Q4_K_M files range from 0.0 to 4.7 GB. Parameter counts run from 4M to 7.57B, and the longest trained context window is 40K tokens.
Frequently asked questions
What GGUF models has sinjab published?
55 models are listed here, mainly from the Marco, Qwen and Jina families. The most downloaded is ms marco MiniLM L6 v2 Q8 0.
Which quants does sinjab publish?
The most common are F16 (19 models), Q8_0 (18 models) and Q4_K_M (18 models).