Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AP
apertus v1.1 swiss embed 0.4b bidir
Apertus · andreasmartin
Params573M
Context4K
Smallest0.6 GB
Embedding
QW
Qwen3 Reranker 4B
Qwen · Zygisluk
Params4.02B
Context40K
Smallest4.3 GB
EmbeddingReasoningTool use
QW
Qwen2.5 1.5B Instruct Code En GGUF 789MB
Qwen · nadizik
Params1.33B
Context32K
Q4_K_M0.8 GB
CodingEmbedding
JI
jina embeddings v2 base en Q4 K M
Jina · walsons
Params137M
Context8K
Q4_K_M0.1 GB
Embedding
MX
Mxbai Embed Large v1
Mxbai · keisuke-miyako
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen3 VL Reranker 2B
Qwen · staralt
Params1.72B
Context256K
Smallest1.3 GB
EmbeddingVision
BG
bge m3 legal euro r28
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
Embedding
AL
all MiniLM L6 v2 Q4 K M
All · Unicorn9x
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
GR
GreenNode Embedding Large VN Mixed V1
Greennode · Keithsel
Params567M
Context8K
Smallest1.2 GB
Embedding
ST
Stella Base En v2
Stella · djuna
Params109M
Context512
Smallest0.1 GB
Embedding
QW
Qwen3 Reranker 0.6B
Qwen · furyzhenxi
Params596M
Context40K
Smallest0.6 GB
EmbeddingReasoningTool use
JI
jina reranker v1 tiny en F16
Jina · sinjab
Params33M
Context8K
Smallest0.1 GB
Embedding
SA
sarashina embedding v2 1b gguf q4 k m
Sarashina · keisuke-miyako
Params1.41B
Context8K
Q4_K_M0.9 GB
Embedding
QW
Gte Qwen2 7B Instruct
Qwen · MichielEeckhout
Params7.61B
Context128K
Q4_K_M4.7 GB
Embedding
GR
Granite Embedding 278m Multilingual
Granite · mrutkows
Params277M
Context512
Q4_K_M0.2 GB
Embedding
PA
Paraphrase Multilingual Mpnet Base v2
Paraphrase · pyarn
Params277M
Context512
Smallest0.3 GB
Embedding
MA
ms marco MiniLM L4 v2 F16
Marco · sinjab
Params19M
Context512
Smallest0.0 GB
CodingEmbedding
MX
Mxbai Rerank Base v2
Mxbai · keisuke-miyako
Params494M
Context32K
Smallest0.5 GB
EmbeddingTool use
LA
e5-large-v2
Large · Pekarnick
Params334M
Context512
Q4_K_M0.2 GB
Embedding
BG
Bge Code v1
BGE · wolframko
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingEmbeddingTool use
BG
bge reranker large Q4 K M
BGE · MOLUOKA
Params560M
Context512
Q4_K_M0.4 GB
Embedding
OC
Octen Embedding 8B
Octen · nicoghost124
Params7.57B
Context40K
Q4_K_M4.7 GB
EmbeddingTool use
SN
snowflake-arctic-embed-l
Snowflake · radia
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
Gte Qwen2 7B Instruct
Qwen · Bearsaerker
Params7.61B
Context128K
Smallest5.4 GB
Embedding
BG
bge reranker large F16
BGE · sinjab
Params560M
Context512
Smallest1.1 GB
Embedding
MA
ms marco TinyBERT L2 v2 Q4 K M
Marco · sinjab
Params4M
Context512
Q4_K_M0.0 GB
CodingEmbedding
EM
embeddinggemma 300m Q8 0 better
Embeddinggemma · mntcloud
Params308M
Context2K
Smallest0.3 GB
Embedding
CO
Conan_Embedding_V1
Conan · lagoon999
Params324M
Context512
Q4_K_M0.2 GB
Embedding
ME
Medgemma 27b It
Medgemma · thantnaylin
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
CO
lightonai colbert zero f32
Colbert · embedme
Params149M
Context8K
Smallest0.6 GB
Embedding

Other uses

Keep browsing