GGUF models by sinjab

55 GGUF models quantized by sinjab on Hugging Face. Sizes run from 4M to 7.57B parameters. The longest trained context is 40K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
jina reranker v1 tiny en F16
Jina · sinjab
Params33M
Context8K
Smallest0.1 GB
Embedding
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
CodingEmbedding
BG
bge reranker large F16
BGE · sinjab
Params560M
Context512
Smallest1.1 GB
Embedding
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
CodingEmbedding
QW
Qwen3 Reranker 8B
Qwen · sinjab
Params7.57B
Context40K
Smallest8.0 GB
EmbeddingReasoningTool use
MA
ms marco MiniLM L2 v2 Q8 0
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco TinyBERT L2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L2 v2 F16
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco TinyBERT L2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
CodingEmbedding
JI
jina reranker v1 tiny en Q8 0
Jina · sinjab
Params33M
Context8K
Smallest0.0 GB
Embedding
MA
ms marco TinyBERT L2 v2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
JI
jina reranker v1 tiny en Q4 K M
Jina · sinjab
Params33M
Context8K
Q4_K_M0.0 GB
Embedding
BG
bge reranker large Q4 K M
BGE · sinjab
Params560M
Context512
Q4_K_M0.4 GB
Embedding
MA
ms marco MiniLM L4 v2 Q8 0
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L12 v2 F16
Marco · sinjab
Params33M
Context512
Smallest0.1 GB
CodingEmbedding
MA
ms marco TinyBERT L4 F16
Marco · sinjab
Params14M
Context512
Smallest0.0 GB
CodingEmbedding
MX
Mxbai Rerank Base v2
Mxbai · sinjab
Params494M
Context32K
Smallest1.0 GB
EmbeddingTool use
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
CodingEmbedding
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest3.1 GB
EmbeddingTool use
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest1.6 GB
EmbeddingTool use
MA
ms marco TinyBERT L2 v2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
MA
ms marco MiniLM L2 v2 Q4 K M
Marco · sinjab
Params16M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
ms marco TinyBERT L6 F16
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
CodingEmbedding
MA
ms marco TinyBERT L6 Q8 0
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
CodingEmbedding
MA
ms marco TinyBERT L6 Q4 K M
Marco · sinjab
Params66M
Context512
Q4_K_M0.0 GB
CodingEmbedding

Keep browsing