Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
GE
Sakura Gemma4 E2B EmbeddingGemma2 DualMode
Gemma · webmp3
Params4.65B
Context128K
Smallest3.6 GB
JI
jina reranker v1 tiny en
Jina · gpustack
Params33M
Context8K
Q4_K_M0.0 GB
JI
Jina Embeddings v5 Text Nano Clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
QW
Qwen3.8 27B DSpark
Qwen · Anbeeld
Params1.86B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5 9B DFlash
Qwen · Anbeeld
Params1.29B
Context256K
Q4_K_M0.8 GB
JI
jina embeddings v5 omni nano classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
QW
Qwen3 Reranker 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3-Reranker-4B
Qwen · gorse-io
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 Reranker 4B
Qwen · giladgd
Params4B
Context40K
Q4_K_M2.5 GB
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
BG
bge-small-en-v1.5
BGE · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
LA
labse
Labse · ChristianAzinn
Params470M
Context512
Q4_K_M0.4 GB
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
JI
jina embeddings v2 base code Q8 0
Jina · ggml-org
Params160M
Context8K
Smallest0.2 GB
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
EM
xVITA Embed2 zhTW
Embeddinggemma · xCloudinfo
Params271M
Context256K
Q4_K_M0.2 GB
SA
Sahya 7B slerp
Sahya · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
MA
ms marco MiniLM L 6 v2
Marco · cstr
Params23M
Context512
Smallest0.0 GB
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
BI
BillyTheKid1803
Billythekid · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
qwen3 embed 8b
Qwen · cstr
Params7.57B
Context40K
Smallest4.4 GB