Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
GT
Gte Base
Gte · groonga
Params109M
Context512
Q4_K_M0.1 GB
QW
Qwen3 Reranker 0.6B
Qwen · felipe-cmsa
Params596M
Context40K
Smallest0.6 GB
EM
Embeddinggemma 300m
Embeddinggemma · sarav1n
Params303M
Context2K
Smallest0.3 GB
MA
ms marco MiniLM L2 v2 Q8 0
Marco · sinjab
Params16M
Context512
Smallest0.0 GB
QW
Qwen3 Embedding 4B GGUF Q4 K M
Qwen · majentik
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 Embedding 0.6B
Qwen · teleprint-me
Params596M
Context32K
Smallest1.2 GB
BG
bge m3 Q8 0
BGE · potatoshi
Params567M
Context8K
Smallest0.6 GB
MX
mxbai embed xsmall v1 i1
Mxbai · mradermacher
Params24M
Context4K
Q4_K_M0.0 GB
AL
all MiniLM L6 v2 Q4 K M
All · sabafallah
Params23M
Context512
Q4_K_M0.0 GB
JI
Jina Reranker v2 Base Multilingual
Jina · keisuke-miyako
Params278M
Context1K
Smallest0.3 GB
BG
bge reranker large Q4 K M
BGE · pyarn
Params560M
Context512
Q4_K_M0.4 GB
CO
codebert base cd ft
Codebert · mradermacher
Params124M
Context512
Q4_K_M0.1 GB
LE
legal ft 1 Q8 0
Legal · Sleem247
Params334M
Context512
Smallest0.4 GB
GT
Gte Modernbert Base
Gte · eranmazur
Params149M
Context8K
Smallest0.2 GB
JI
jina embeddings v2 base zh Q8 0
Jina · Ashcomposer
Params160M
Context8K
Smallest0.2 GB
QW
Qwen3 Reranker
Qwen · worndown
Params596M
Context40K
Smallest1.2 GB
LY
Lychee Embed
Lychee · TensorVizion
Params1.54B
Context32K
Smallest1.3 GB
EM
Embeddinggemma 300m
Embeddinggemma · ops-ping
Params303M
Context2K
Q4_K_M0.2 GB
HO
Hourai3 7m Embedding Ja Gguf
Hourai · WariHima
Params7M
Context125K
Smallest0.0 GB
DM
Dmeta-embedding-zh-small
Dmeta · wencan-lab
Params74M
Context1K
Q4_K_M0.1 GB
NO
Nomic Embed Text v1.5
Nomic · badger212
Params137M
Context2K
Smallest0.1 GB
QI
qiqiquq sft reranker step2000 1203
Qiqiquq · RichardErkhov
Params7.25B
Context32K
Smallest2.7 GB
BG
bge reranker v2 m3 Q8 0
BGE · darkgeekyang
Params568M
Context8K
Smallest0.6 GB
GR
Granite Embedding 107m Multilingual
Granite · stefanberger
Params107M
Context512
Q4_K_M0.1 GB
BG
bge-large-en-v1.5
BGE · archit28
Params334M
Context512
Smallest0.2 GB
KA
KaLM Embedding Multilingual Mini Instruct v2
Kalm · colintoal
Params494M
Context128K
Smallest1.0 GB
EM
embedding
Embedding · SciTools
Params33M
Context512
Smallest0.1 GB
BG
bge embedding model
BGE · ragbox
Params567M
Context8K
Smallest0.6 GB
KO
KoE5 Q5 K M
Koe · SaBeom
Params559M
Context512
Smallest0.4 GB
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · tinybiggames
Params303M
Context2K
Smallest0.3 GB