Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
EM
Ze1 1.1B Embedded Instruct
Embedded · anyze
Params1.1B
Context2K
Smallest2.2 GB
PO
PolDense-68M
Poldense · kprzyb
Params68M
Context8K
Smallest0.1 GB
GR
granite embedding 97m multilingual r2
Granite · terminela
Params97M
Context32K
Smallest0.1 GB
UL
UltraBERT-Embed-150M
Ultrabert · cstr
Params151M
Context32K
Smallest0.6 GB
QW
qwen3 8b text embedding
Qwen · akahana
Params7.57B
Context40K
Q4_K_M4.7 GB
LL
prosparse llama 2 13b
Llama · SparseLLM
Params13B
Context—
Smallest27.6 GB
QW
Qwen3 Embedding 0.6b
Qwen · CompendiumLabs
Params596M
Context32K
Smallest0.4 GB
GT
gte small
Gte · cstr
Params33M
Context512
Smallest0.0 GB
GR
Granite Embedding Reranker English R2
Granite · trithemius
Params150M
Context8K
Smallest0.3 GB
QW
Qwen3 Reranker 4B
Qwen · JamePeng2023
Params596M
Context40K
Q4_K_M2.5 GB
EM
mindpage search v1
Embeddinggemma · Mindscend
Params271M
Context256K
Smallest0.3 GB
LL
Imone Llama 3 8B Fixed Special Embedding
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
BG
bge m3 Q8 0
BGE · darrowoflykos
Params567M
Context8K
Smallest0.6 GB
SM
E5 Small
Small · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
MU
multilingual e5 large Q8 0
Multilingual · chris-code
Params559M
Context512
Smallest0.6 GB
QW
micro kiki v3
Qwen · clemsail
Params4.21B
Context256K
Q4_K_M2.7 GB
EM
embeddinggemma2 Q8 0
Embeddinggemma · TszAstrea
Params271M
Context256K
Smallest0.3 GB
TO
Tool Embed 4B
Tool · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
QW
Lq Decide 0.6b
Qwen · Hanish
Params596M
Context40K
Q4_K_M0.4 GB
BG
bge m3 Q4 0
BGE · msyukorai
Params567M
Context8K
Smallest0.4 GB
OP
opensearch neural sparse doc v2 mini
Opensearch · arbazsiddiqui
Params23M
Context512
Smallest0.0 GB
EL
electrical embeddinggemma ir q8 0
Electrical · disham993
Params303M
Context2K
Smallest0.3 GB
PP
PPLX Embed Context V1
Pplx · seamon67
Params4.02B
Context32K
Smallest4.3 GB
EL
electrical embeddinggemma ir q5 k m
Electrical · disham993
Params303M
Context2K
Smallest0.2 GB
SN
snowflake arctic embed s
Snowflake · infosecinnovations
Params33M
Context512
Smallest0.0 GB
QW
Qwen3 Embedding 4B GGUF Q8 0
Qwen · majentik
Params4.02B
Context40K
Smallest4.3 GB
QW
Qwen3 Embedding 0.6B
Qwen · dreadster3
Params596M
Context32K
Smallest0.6 GB
AP
Aptivra Base 110M
Aptivra · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
SM
e5 small v2
Small · mradermacher
Params33M
Context512
Q4_K_M0.0 GB