Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
AP
apertus v1.1 swiss embed 0.4b bidir
Apertus · andreasmartin
Params573M
Context4K
Smallest0.6 GB
QW
Qwen3 Reranker 4B
Qwen · Zygisluk
Params4.02B
Context40K
Smallest4.3 GB
QW
Qwen2.5 1.5B Instruct Code En GGUF 789MB
Qwen · nadizik
Params1.33B
Context32K
Q4_K_M0.8 GB
JI
jina embeddings v2 base en Q4 K M
Jina · walsons
Params137M
Context8K
Q4_K_M0.1 GB
MX
Mxbai Embed Large v1
Mxbai · keisuke-miyako
Params334M
Context512
Q4_K_M0.2 GB
QW
Qwen3 VL Reranker 2B
Qwen · staralt
Params1.72B
Context256K
Smallest1.3 GB
BG
bge m3 legal euro r28
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
AL
all MiniLM L6 v2 Q4 K M
All · Unicorn9x
Params23M
Context512
Q4_K_M0.0 GB
GR
GreenNode Embedding Large VN Mixed V1
Greennode · Keithsel
Params567M
Context8K
Smallest1.2 GB
ST
Stella Base En v2
Stella · djuna
Params109M
Context512
Smallest0.1 GB
QW
Qwen3 Reranker 0.6B
Qwen · furyzhenxi
Params596M
Context40K
Smallest0.6 GB
JI
jina reranker v1 tiny en F16
Jina · sinjab
Params33M
Context8K
Smallest0.1 GB
SA
sarashina embedding v2 1b gguf q4 k m
Sarashina · keisuke-miyako
Params1.41B
Context8K
Q4_K_M0.9 GB
QW
Gte Qwen2 7B Instruct
Qwen · MichielEeckhout
Params7.61B
Context128K
Q4_K_M4.7 GB
GR
Granite Embedding 278m Multilingual
Granite · mrutkows
Params277M
Context512
Q4_K_M0.2 GB
PA
Paraphrase Multilingual Mpnet Base v2
Paraphrase · pyarn
Params277M
Context512
Smallest0.3 GB
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
MX
Mxbai Rerank Base v2
Mxbai · keisuke-miyako
Params494M
Context32K
Smallest0.5 GB
LA
e5-large-v2
Large · Pekarnick
Params334M
Context512
Q4_K_M0.2 GB
BG
Bge Code v1
BGE · wolframko
Params1.54B
Context32K
Q4_K_M1.0 GB
BG
bge reranker large Q4 K M
BGE · MOLUOKA
Params560M
Context512
Q4_K_M0.4 GB
OC
Octen Embedding 8B
Octen · nicoghost124
Params7.57B
Context40K
Q4_K_M4.7 GB
SN
snowflake-arctic-embed-l
Snowflake · radia
Params334M
Context512
Q4_K_M0.2 GB
QW
Gte Qwen2 7B Instruct
Qwen · Bearsaerker
Params7.61B
Context128K
Smallest5.4 GB
BG
bge reranker large F16
BGE · sinjab
Params560M
Context512
Smallest1.1 GB
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
EM
embeddinggemma 300m Q8 0 better
Embeddinggemma · mntcloud
Params308M
Context2K
Smallest0.3 GB
CO
Conan_Embedding_V1
Conan · lagoon999
Params324M
Context512
Q4_K_M0.2 GB
ME
Medgemma 27b It
Medgemma · thantnaylin
Params27B
Context128K
Q4_K_M16.5 GB
CO
lightonai colbert zero f32
Colbert · embedme
Params149M
Context8K
Smallest0.6 GB