Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B Merge 14 v0.4
Mistral · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
BG
bge m3
BGE · amiya
Params567M
Context8K
Smallest1.2 GB
JI
jina embeddings v2 base es Q2 K
Jina · AndreasX
Params160M
Context8K
Smallest0.1 GB
MA
ms marco MiniLM L12 v2 Q8 0
Marco · sinjab
Params33M
Context512
Smallest0.0 GB
YU
Yuan Embedding 2.0 Zh
Yuan · yeahbeen
Params324M
Context512
Q4_K_M0.2 GB
NS
NSFW GIST Small
Nsfw · Novaciano
Params33M
Context512
Smallest0.0 GB
BG
bge reranker large Q8 0
BGE · felixzyx
Params560M
Context512
Smallest0.6 GB
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest3.1 GB
SA
Sarashina Embedding v2 1b
Sarashina · kushalc1
Params1.22B
Context8K
Q4_K_M0.8 GB
MO
Modernbert Embed Base
Modernbert · keisuke-miyako
Params149M
Context8K
Smallest0.2 GB
ST
Stsb Xlm R Multilingual
Stsb · hongkeon
Params277M
Context512
Q4_K_M0.2 GB
QW
Gte Qwen2 7B Instruct
Qwen · bnightning
Params7.61B
Context128K
Q4_K_M4.7 GB
PA
Paraphrase Multilingual Mpnet Base v2
Paraphrase · pocohos
Params277M
Context512
Smallest0.2 GB
CO
Conan_Embedding_V1
Conan · KenLi315
Params324M
Context512
Q4_K_M0.2 GB
JI
jina embeddings v2 base zh Q8 0
Jina · phate334
Params160M
Context8K
Smallest0.2 GB
GR
granite embedding small english r2 gguf q4 k m
Granite · keisuke-miyako
Params149M
Context8K
Q4_K_M0.1 GB
AD
b1ade-embed
Ade · mxs980
Params334M
Context512
Smallest0.4 GB
QW
Qwen3 Reranker 8B
Qwen · malammal
Params8.19B
Context40K
Smallest8.7 GB
BG
bge m3 Q8 0
BGE · Chiwei
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · worndown
Params596M
Context32K
Smallest1.2 GB
GT
Gte Reranker Modernbert Base
Gte · sami7786
Params150M
Context8K
Smallest0.2 GB
GR
Granite Embedding
Granite · rafpigna
Params312M
Context32K
Smallest0.3 GB
QW
Qwen3 Reranker 8B
Qwen · bdesnos
Params7.57B
Context40K
Smallest6.2 GB
QW
Qwen3 Reranker 0.6B
Qwen · ManiKumarAdapala
Params596M
Context40K
Smallest0.6 GB
BG
bge m3 legal euro r23
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Reranker 8B
Qwen · greenwich157
Params8.19B
Context40K
Smallest8.7 GB
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Smallest1.6 GB
GR
Granite Embedding 107m Multilingual
Granite · mrutkows
Params107M
Context512
Q4_K_M0.1 GB
BG
bge m3 Q4 K M
BGE · jeremyys
Params567M
Context8K
Q4_K_M0.4 GB
GR
Granite Embedding 278m Multilingual
Granite · hongkeon
Params277M
Context512
Q4_K_M0.2 GB