Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
CZ
czech semantic embeddings
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
AL
all MiniLM L6 v2 Q8 0
All · enacimie
Params23M
Context512
Smallest0.0 GB
BG
USER Bge M3
BGE · michael-vasiljev
Params358M
Context8K
Smallest0.4 GB
PA
paraphrase-multilingual-MiniLM-L12-v2
Paraphrase · armand01
Params118M
Context512
Smallest0.1 GB
RI
Ritrieve_Zh_V1
Ritrieve · dwdcth
Params324M
Context512
Q4_K_M0.2 GB
QW
Qwen3 VL Embedding 8B
Qwen · ganeshrao
Params7.57B
Context256K
Smallest8.0 GB
QW
Qwen3 VL Embedding 2B
Qwen · imbenwolf
Params1.72B
Context256K
Q4_K_M1.1 GB
MA
MarcMistral 7B
Marcmistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NO
CodeRankEmbed Q8 0
Nomic · awhiteside
Params137M
Context2K
Smallest0.1 GB
BG
bge reranker v2 m3 Q4 K M
BGE · sehiro
Params568M
Context8K
Q4_K_M0.4 GB
QW
Qwen3 Reranker 8B
Qwen · enacimie
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 Reranker 0.6B
Qwen · ExpedientFalcon
Params596M
Context40K
Q4_K_M0.4 GB
QW
gte-Qwen2-7B-instruct
Qwen · mirekphd
Params7.61B
Context128K
Smallest8.1 GB
MX
Mxbai Rerank Large v2
Mxbai · jj701
Params1.54B
Context32K
Smallest1.3 GB
NO
Nomic Embed Text v1.5
Nomic · nesall
Params137M
Context2K
Smallest0.1 GB
MA
ms marco MiniLM L12 v2 Q4 K M
Marco · sinjab
Params33M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Embedding 8B
Qwen · hugger7326
Params7.57B
Context40K
Smallest8.0 GB
QW
Qwen3 Reranker 8B
Qwen · G17c21ds
Params7.57B
Context40K
Q4_K_M4.7 GB
QW
Qwen3 Embedding 0.6B
Qwen · hugger7326
Params596M
Context32K
Smallest0.6 GB
JI
Jina Embeddings v4 Vllm Retrieval
Jina · straino
Params3.09B
Context125K
Smallest3.3 GB
AL
all MiniLM L6 v2 Q4 0
All · huoxu
Params23M
Context512
Smallest0.0 GB
QW
Qwen3 Embedding 8b
Qwen · CompendiumLabs
Params7.57B
Context40K
Smallest5.4 GB
HA
harrier v1 270m
Harrier · shalyhinpavel
Params268M
Context32K
Q4_K_M0.3 GB
ME
medical 1000 64 16 jinaai jina embeddings v2 small en 10 gpt 4 turbo 0 9062874564
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
HA
harrier oss v1 0.6b GGUF Q5 K M
Harrier · majentik
Params596M
Context32K
Smallest0.4 GB
DE
Deepset Mxbai Embed De Large v1
Deepset · keisuke-miyako
Params486M
Context512
Smallest0.5 GB
LL
Ft Counsel Meta Llama 3.1 8B Instruct Jepa Loraembed
Llama · renaudb1999
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
deepkit code reranker
Qwen · bartscheffer
Params596M
Context40K
Smallest0.6 GB
QW
Gte Qwen2 7B Instruct
Qwen · brtaydin
Params7.61B
Context128K
Smallest5.4 GB
JI
jina embeddings v5 omni nano retrieval
Jina · Yirasumi
Params212M
Context8K
Q4_K_M0.3 GB