Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
bge reranker base gguf q4 k m
BGE · keisuke-miyako
Params278M
Context512
Q4_K_M0.2 GB
Embedding
LA
lightonai lateon Q8 0
Lateon · embedme
Params149M
Context8K
Smallest0.2 GB
Embedding
MI
mistral embedded c instruct v0.4
Mistral · gouthamsk
Params7.24B
Context32K
Smallest7.7 GB
Embedding
YI
Classical Yinka IQ4 XS
Yinka · HiDolen
Params324M
Context512
Smallest0.2 GB
Embedding
XI
Xiaobu Embedding v2
Xiaobu · jd04063221
Params324M
Context512
Q4_K_M0.2 GB
Embedding
FI
Deepset Mxbai Embed De Large v1
Finetuned · AKI0284
Params486M
Context512
Smallest0.5 GB
Embedding
MO
Modern_Ancientpoem_Encoder
Modern · dwdcth
Params324M
Context512
Q4_K_M0.2 GB
CodingEmbedding
DI
Distilroberta Base
Distilroberta · Sleem247
Params82M
Context512
Smallest0.1 GB
Embedding
QW
Qwen3 Reranker 0.6B
Qwen · pkgprateek
Params596M
Context40K
Smallest0.6 GB
EmbeddingReasoningTool use
RI
Ritrieve_Zh_V1
Ritrieve · Hoshino-Yumetsuki
Params324M
Context512
Smallest0.3 GB
Embedding
QW
Gme Qwen2 VL 7B Instruct
Qwen · cherryDavid
Params7.62B
Context32K
Q4_K_M4.7 GB
EmbeddingVision
AP
Aptivra Base 110M
Aptivra · raghunath1
Params109M
Context512
Q4_K_M0.1 GB
Embedding
BG
bge large en v1.5 ggml f16
BGE · rbehzadan
Params334M
Context512
Smallest0.7 GB
Embedding
MX
Mxbai Embed Large v1
Mxbai · stellarator
Params334M
Context512
Smallest0.2 GB
Embedding
ME
med embed models
Med · fudanjx
Params334M
Context512
Smallest0.7 GB
Embedding
YU
Yuan embedding 1.0
Yuan · HuanLin
Params324M
Context512
Smallest0.7 GB
Embedding
CO
Conan_Embedding_V1
Conan · LFAKLI
Params324M
Context512
Q4_K_M0.2 GB
Embedding
MU
multilingual e5 base Q4 K M
Multilingual · jeremyys
Params277M
Context512
Q4_K_M0.2 GB
Embedding
MA
ms marco TinyBERT L2 v2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen3 Reranker 0.6B
Qwen · endyjasmi
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
GT
Gte Large
Gte · groonga
Params334M
Context512
Q4_K_M0.2 GB
Embedding
EM
EmbeddingGemma 300M De KCIB Medical
Embeddinggemma · JatinkInnovision
Params303M
Context2K
Q4_K_M0.2 GB
EmbeddingVision
GR
Granite Embedding English R2
Granite · mrutkows
Params149M
Context8K
Smallest0.2 GB
Embedding
QW
Qwen3 Reranker 0.6B
Qwen · felipe-cmsa
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
AL
all MiniLM L6 v2 Q8 0
All · embedme
Params23M
Context512
Smallest0.0 GB
Embedding
JA
my optimal model GGUF with sysprompt
Jaii · yamraj047
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
BG
bge reranker large gguf q4 k m
BGE · keisuke-miyako
Params560M
Context512
Q4_K_M0.4 GB
Embedding
BG
Bge Base En v1.5
BGE · fisher046
Params109M
Context512
Smallest0.1 GB
Embedding
AL
all MiniLM L6 v2 Q4 K M
All · z8086486
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MA
ms marco MiniLM L2 v2 Q4 K M
Marco · sinjab
Params16M
Context512
Q4_K_M0.0 GB
CodingEmbedding

Other uses

Keep browsing