Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Sakura Gemma4 E2B EmbeddingGemma2 DualMode
Gemma · webmp3
Params4.65B
Context128K
Smallest3.6 GB
Embedding
JI
jina reranker v1 tiny en
Jina · gpustack
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
JI
Jina Embeddings v5 Text Nano Clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
QW
Qwen3.8 27B DSpark
Qwen · Anbeeld
Params1.86B
Context256K
Q4_K_M1.1 GB
CodingEmbedding
QW
Qwen3.5 9B DFlash
Qwen · Anbeeld
Params1.29B
Context256K
Q4_K_M0.8 GB
CodingEmbedding
JI
jina embeddings v5 omni nano classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingVision
QW
Qwen3 Reranker 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Embedding
QW
Qwen3-Reranker-4B
Qwen · gorse-io
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Qwen3 Reranker 4B
Qwen · giladgd
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
CodingEmbedding
BG
bge-small-en-v1.5
BGE · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
Embedding
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
Embedding
LA
labse
Labse · ChristianAzinn
Params470M
Context512
Q4_K_M0.4 GB
Embedding
MU
multilingual e5 small
Multilingual · TwinSunsLLC
Params118M
Context511
Smallest0.1 GB
Embedding
JI
jina embeddings v2 base code Q8 0
Jina · ggml-org
Params160M
Context8K
Smallest0.2 GB
CodingEmbedding
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Embedding
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingVision
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
CodingEmbedding
EM
xVITA Embed2 zhTW
Embeddinggemma · xCloudinfo
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
SA
Sahya 7B slerp
Sahya · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Embedding
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
EmbeddingVision
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
MA
ms marco MiniLM L 6 v2
Marco · cstr
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
BI
BillyTheKid1803
Billythekid · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Embedding
QW
qwen3 embed 8b
Qwen · cstr
Params7.57B
Context40K
Smallest4.4 GB
Embedding

Other uses

Keep browsing