Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Merge 14 v0.4
Mistral · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
Embedding
BG
bge m3
BGE · amiya
Params567M
Context8K
Smallest1.2 GB
Embedding
JI
jina embeddings v2 base es Q2 K
Jina · AndreasX
Params160M
Context8K
Smallest0.1 GB
Embedding
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
CodingEmbedding
YU
Yuan Embedding 2.0 Zh
Yuan · yeahbeen
Params324M
Context512
Q4_K_M0.2 GB
Embedding
NS
NSFW GIST Small
Nsfw · Novaciano
Params33M
Context512
Smallest0.0 GB
Embedding
BG
bge reranker large Q8 0
BGE · felixzyx
Params560M
Context512
Smallest0.6 GB
Embedding
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest3.1 GB
EmbeddingTool use
SA
Sarashina Embedding v2 1b
Sarashina · kushalc1
Params1.22B
Context8K
Q4_K_M0.8 GB
Embedding
MO
Modernbert Embed Base
Modernbert · keisuke-miyako
Params149M
Context8K
Smallest0.2 GB
Embedding
ST
Stsb Xlm R Multilingual
Stsb · hongkeon
Params277M
Context512
Q4_K_M0.2 GB
Embedding
QW
Gte Qwen2 7B Instruct
Qwen · bnightning
Params7.61B
Context128K
Q4_K_M4.7 GB
Embedding
PA
Paraphrase Multilingual Mpnet Base v2
Paraphrase · pocohos
Params277M
Context512
Smallest0.2 GB
Embedding
CO
Conan_Embedding_V1
Conan · KenLi315
Params324M
Context512
Q4_K_M0.2 GB
Embedding
JI
jina embeddings v2 base zh Q8 0
Jina · phate334
Params160M
Context8K
Smallest0.2 GB
Embedding
GR
granite embedding small english r2 gguf q4 k m
Granite · keisuke-miyako
Params149M
Context8K
Q4_K_M0.1 GB
Embedding
AD
b1ade-embed
Ade · mxs980
Params334M
Context512
Smallest0.4 GB
Embedding
QW
Qwen3 Reranker 8B
Qwen · malammal
Params8.19B
Context40K
Smallest8.7 GB
EmbeddingReasoningTool use
BG
bge m3 Q8 0
BGE · Chiwei
Params567M
Context8K
Smallest0.6 GB
Embedding
QW
Qwen3 Embedding 0.6B
Qwen · worndown
Params596M
Context32K
Smallest1.2 GB
EmbeddingReasoningTool use
GT
Gte Reranker Modernbert Base
Gte · sami7786
Params150M
Context8K
Smallest0.2 GB
Embedding
GR
Granite Embedding
Granite · rafpigna
Params312M
Context32K
Smallest0.3 GB
Embedding
QW
Qwen3 Reranker 8B
Qwen · bdesnos
Params7.57B
Context40K
Smallest6.2 GB
EmbeddingReasoningTool use
QW
Qwen3 Reranker 0.6B
Qwen · ManiKumarAdapala
Params596M
Context40K
Smallest0.6 GB
EmbeddingReasoningTool use
BG
bge m3 legal euro r23
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
Embedding
QW
Qwen3 Reranker 8B
Qwen · greenwich157
Params8.19B
Context40K
Smallest8.7 GB
EmbeddingReasoningTool use
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest1.6 GB
EmbeddingTool use
GR
Granite Embedding 107m Multilingual
Granite · mrutkows
Params107M
Context512
Q4_K_M0.1 GB
Embedding
BG
bge m3 Q4 K M
BGE · jeremyys
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
GR
Granite Embedding 278m Multilingual
Granite · hongkeon
Params277M
Context512
Q4_K_M0.2 GB
Embedding

Other uses

Keep browsing