Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
JI
jina embeddings v2 base de Q8 0
Jina · chris-code
Params160M
Context8K
Smallest0.2 GB
GR
Granite Embedding 278m Multilingual
Granite · badger212
Params277M
Context512
Q4_K_M0.2 GB
GR
Granite Embedding 30m English
Granite · stefanberger
Params30M
Context512
Q4_K_M0.0 GB
SN
Snowflake Arctic Embed M v1.5
Snowflake · yishan-wang
Params109M
Context512
Smallest0.1 GB
MU
multilingual e5 large Q4 K M
Multilingual · sehiro
Params559M
Context512
Q4_K_M0.4 GB
SN
snowflake arctic legal ft 1 Q8 0
Snowflake · Sleem247
Params334M
Context512
Smallest0.4 GB
CH
chatbot sentence transformer Q8 0
Chatbot · Sleem247
Params82M
Context512
Smallest0.1 GB
GR
Granite Embedding 107m Multilingual
Granite · keisuke-miyako
Params107M
Context512
Q4_K_M0.1 GB
GR
Granite Embedding 278m Multilingual
Granite · keisuke-miyako
Params277M
Context512
Smallest0.3 GB
BG
bge reranker v2 m3 Q8 0
BGE · lj027
Params568M
Context8K
Smallest0.6 GB
NO
Nomic Embed Text v1.5
Nomic · Tazza991
Params137M
Context2K
Smallest0.1 GB
MX
Mxbai Rerank Base v2
Mxbai · sinjab
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 VL Reranker 8B
Qwen · cheers26
Params8.19B
Context256K
Smallest8.7 GB
QW
Gte Qwen2 1.5B Instruct
Qwen · Fashion-Italia
Params1.78B
Context128K
Q4_K_M1.1 GB
NO
Nomic Embed Text v1.5
Nomic · straino
Params137M
Context2K
Smallest0.1 GB
QW
Qwen3 Reranker 4B
Qwen · Zygisluk
Params4.02B
Context40K
Q4_K_M2.5 GB
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · AlvinYuan
Params303M
Context2K
Smallest0.3 GB
AL
all MiniLM L6 v2 Q8 0
All · Unicorn9x
Params23M
Context512
Smallest0.0 GB
HA
harrier gst embed v1
Harrier · chanderbalaji
Params596M
Context32K
Smallest0.6 GB
MX
Mxbai Rerank Large v2
Mxbai · sinjab
Params1.54B
Context32K
Q4_K_M1.0 GB
AL
all MiniLM L6 v2 f32
All · niushuai1991
Params23M
Context512
Smallest0.1 GB
BG
Bge Base En v1.5
BGE · nesall
Params109M
Context512
Q4_K_M0.1 GB
MA
ms marco MiniLM L4 v2 Q4 K M
Marco · sinjab
Params19M
Context512
Q4_K_M0.0 GB
RU
Rubert Mini Uncased
Rubert · sergeyzh
Params37M
Context512
Smallest0.0 GB
QW
Qwen3 Reranker 8B
Qwen · sinjab
Params7.57B
Context40K
Smallest15.1 GB
GE
bge reranker v2 gemma Q4 K M
Gemma · pyarn
Params2.51B
Context8K
Q4_K_M1.6 GB
SN
Snowflake Arctic Embed Xs
Snowflake · yixuan-chia
Params23M
Context512
Q4_K_M0.0 GB
GR
granite embedding 125m english
Granite · stefanberger
Params124M
Context512
Q4_K_M0.1 GB
QW
Qwen3 Reranker 8B
Qwen · ExpedientFalcon
Params8.19B
Context40K
Smallest8.7 GB
DE
lightonai denseon Q8 0
Denseon · embedme
Params149M
Context8K
Smallest0.2 GB