GGUF models by sinjab
55 GGUF models quantized by sinjab on Hugging Face. Sizes run from 4M to 7.57B parameters. The longest trained context is 40K tokens.
JI
jina reranker v1 tiny en F16
Jina · sinjab
Params33M
Context8K
Smallest0.1 GB
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
BG
bge reranker large F16
BGE · sinjab
Params560M
Context512
Smallest1.1 GB
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 8B
Qwen · sinjab
Params7.57B
Context40K
Smallest8.0 GB
MA
ms marco MiniLM L2 v2 Q8 0
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
MA
ms marco TinyBERT L2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L2 v2 F16
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
MA
ms marco TinyBERT L2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
JI
jina reranker v1 tiny en Q8 0
Jina · sinjab
Params33M
Context8K
Smallest0.0 GB
MA
ms marco TinyBERT L2 v2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
JI
jina reranker v1 tiny en Q4 K M
Jina · sinjab
Params33M
Context8K
Q4_K_M0.0 GB
BG
bge reranker large Q4 K M
BGE · sinjab
Params560M
Context512
Q4_K_M0.4 GB
MA
ms marco MiniLM L4 v2 Q8 0
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L12 v2 F16
Marco · sinjab
Params33M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L4 F16
Marco · sinjab
Params14M
Context512
Smallest0.0 GB
MX
Mxbai Rerank Base v2
Mxbai · sinjab
Params494M
Context32K
Smallest1.0 GB
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest3.1 GB
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest1.6 GB
MA
ms marco TinyBERT L2 v2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
MA
ms marco MiniLM L2 v2 Q4 K M
Marco · sinjab
Params16M
Context512
Q4_K_M0.0 GB
MA
ms marco TinyBERT L6 F16
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L6 Q8 0
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L6 Q4 K M
Marco · sinjab
Params66M
Context512
Q4_K_M0.0 GB