Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
JI
jina reranker v1 tiny en Q8 0
Jina · sinjab
Params33M
Context8K
Smallest0.0 GB
MX
mxbai-rerank-large-v2
Mxbai · keisuke-miyako
Params1.54B
Context32K
Smallest1.6 GB
BG
bge m3 Korean Judgment Transducer Verifier v1.0 Q8 0
BGE · hongkeon
Params567M
Context8K
Smallest0.6 GB
QW
Gte Qwen2 7B Instruct
Qwen · datouge
Params7.61B
Context128K
Smallest4.4 GB
JI
Jina Embeddings v3
Jina · sabafallah
Params558M
Context8K
Q4_K_M0.4 GB
JI
Jina Embeddings v4 Vllm Retrieval
Jina · straino
Params3.09B
Context125K
Smallest2.2 GB
GE
GEMMA3 Micio IT
Gemma · loll070303
Params268M
Context32K
Smallest0.5 GB
AL
all MiniLM L12 v2 Q8 0
All · sheldonrobinson
Params33M
Context512
Smallest0.0 GB
QW
Gte Qwen2 7B Instruct
Qwen · robert-lo
Params7.61B
Context128K
Q4_K_M4.7 GB
DO
m3e doctor i1
Doctor · mradermacher
Params102M
Context512
Q4_K_M0.1 GB
SN
snowflake artic embed l v2.0
Snowflake · rahulvk007
Params567M
Context8K
Smallest1.2 GB
ZE
Zerank 1 4B
Zerank · seamon67
Params4B
Context40K
Smallest4.3 GB
NO
NoInstruct Small Embedding v0
Noinstruct · twine-network
Params33M
Context512
Smallest0.0 GB
JI
jina embeddings v2 base zh Q4 K M
Jina · Ashcomposer
Params160M
Context8K
Q4_K_M0.1 GB
QW
Qwen3 Embedding 0.6b
Qwen · socrate-tech
Params596M
Context32K
Smallest0.6 GB
BG
bge large en Q8 0
BGE · Sleem247
Params334M
Context512
Smallest0.4 GB
MI
MiniLM v34 SemanticEngine
Minilm · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
GR
Granite Embedding 278m Multilingual
Granite · sushantag9
Params277M
Context512
Smallest0.3 GB
GR
Granite Embedding Reranker English R2
Granite · jahn-idt
Params150M
Context8K
Smallest0.2 GB
BC
Bce Embedding Base_V1
Bce · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
BE
Bert MLM arXiv MP class arXiv
Bert · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
BG
bge reranker v2 m3 Q4 K M
BGE · minket06
Params568M
Context8K
Q4_K_M0.4 GB
CO
lightonai colbert zero f16
Colbert · embedme
Params149M
Context8K
Smallest0.3 GB
BG
bge reranker v2 m3 Q8 0
BGE · Chiwei
Params568M
Context8K
Smallest0.6 GB
BG
Bge Micro v2
BGE · Plasmoxy
Params17M
Context512
Q4_K_M0.0 GB
NO
Nomic Embed Text v1.5
Nomic · magicunicorn
Params137M
Context2K
Smallest0.1 GB
QW
Qwen3 VL Embedding 8B
Qwen · indifferentketchup
Params7.57B
Context256K
Q4_K_M4.7 GB
BG
bge medical small en v1.5 i1
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Embedding 0.6B Bf16
Qwen · FILM6912
Params596M
Context32K
Smallest0.6 GB
MU
multilingual e5 large Q4 K M
Multilingual · groonga
Params559M
Context512
Q4_K_M0.4 GB