Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
OP
openPangu Embedded 7B
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
QW
Qwen3 Embedding 4B
Qwen · lm-kit
Params4.02B
Context40K
Q4_K_M2.5 GB
ER
EraX multilingual Rerank 3B V2.0
Erax · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
VO
Voyage 4 Nano
Voyage · MongoDB
Params346M
Context40K
Smallest0.4 GB
MU
multilingual e5 base Q4 K M
Multilingual · groonga
Params277M
Context512
Q4_K_M0.2 GB
SN
Snowflake Arctic Embed Xs
Snowflake · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
BG
bge 1.5
BGE · lm-kit
Params33M
Context512
Smallest0.1 GB
BG
Bge Reranker v2 M3 Eng Nep 16k Trimmed
BGE · luluw
Params329M
Context8K
Q4_K_M0.2 GB
RA
rank1 1.5b
Rank · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
MS
Msmarco Distilbert Dot v5
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
SU
Supertron2 Reranker 2B
Supertron · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Lore Qwen3 Embedding 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
QW
Alibaba NLP Gte Qwen2 1.5B Instruct
Qwen · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
IC
Icis E5 Small v2 Distilled
Icis · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
WI
wisenut-nlp-team/Wisedom-8B-EmbeddingReordering
Wisedom · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MS
Msmarco Distilbert Base Dot Prod v3
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
BG
bge small en v1.5
BGE · thlurte
Params33M
Context512
Q4_K_M0.0 GB
OL
olmoe 1b 7b compacted 5b
OLMo · continuum-ai
Params5.31B
Context4K
Smallest3.8 GB
MX
mxbai rerank base v1
Mxbai · antflydb
Params184M
Context512
Smallest0.1 GB
MX
mxbai-embed-large-v1
Mxbai · Yunziyou
Params334M
Context512
Smallest0.7 GB
CU
cupidon mini ro
Cupidon · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
NO
nomic embed text v2 moe Q8 0
Nomic · Torkovweryyy
Params475M
Context512
Smallest0.5 GB
EL
electrical embeddinggemma ir f16
Electrical · disham993
Params303M
Context2K
Smallest0.6 GB
EM
embeddinggemma-2
Embeddinggemma · meetara-lab
Params271M
Context256K
Smallest0.3 GB
SM
e5 small v2 i1
Small · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
OP
openPangu Embedded 1B
Openpangu · mradermacher
Params1.16B
Context32K
Q4_K_M0.8 GB
BA
m3e base i1
Base · mradermacher
Params102M
Context512
Q4_K_M0.1 GB
MX
mxbai-embed-large-v1
Mxbai · mitanshu-reckonsys
Params334M
Context512
Smallest0.7 GB
LL
prosparse llama 2 7b
Llama · Tiiny
Params7B
Context—
Smallest14.5 GB
GT
gte base en v1.5
Gte · cstr
Params137M
Context8K
Smallest0.1 GB