Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
MX
Mxbai Rerank Large v2
Mxbai · DevQuasar-11
Params1.54B
Context32K
Q4_K_M1.0 GB
OP
openPangu Embedded 7B DeepDiver
Openpangu · mradermacher
Params8.03B
Context144K
Q4_K_M4.9 GB
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
QW
Whittle Next 26B A3B
Qwen · logic65
Params26.6B
Context256K
Smallest28.3 GB
JI
jina embeddings v2 base de
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
BA
Bamboo base v0.1
Bamboo · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MX
mxbai rerank xsmall v1
Mxbai · cstr
Params71M
Context512
Smallest0.1 GB
QW
Qwen3_Embedding_4B_Q8_0
Qwen · itsbohara
Params4.02B
Context40K
Smallest4.3 GB
XV
xVITA Embed 300M zhTW
Xvita · xCloudinfo
Params308M
Context8K
Smallest0.3 GB
QW
Qwen3 Reranker 0.6B seq cls
Qwen · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
LI
lightblue reranker 0.5 bincont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
GR
Granite Embedding 97m Multilingual R2
Granite · xnohat
Params97M
Context32K
Q4_K_M0.1 GB
SQ
sqlite lembed model examples
Sqlite · asg017
Params23M
Context512
Smallest0.0 GB
OC
Octen Embedding 4B
Octen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
GR
Granite Embedding 311m Multilingual R2
Granite · mykor
Params312M
Context8K
Q4_K_M0.3 GB
QW
Mursit Embed Qwen3 1.7B TR
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3 Embedding 8B Bf16
Qwen · Mungert
Params7.57B
Context40K
Q4_K_M4.6 GB
QW
Qwen3 Embedding Medical 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GT
Gte Large
Gte · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
GE
gemma 2 9b neogenesis ita i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.1 ReRank YesNo
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Sakura Gemma4 E4B EmbeddingGemma2 DualMode
Gemma · webmp3
Params7.52B
Context128K
Smallest5.8 GB
FL
FlashbackMist dare
Flashbackmist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama Nemotron Embed 1b v2
Llama · mykor
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
LI
lightblue reranker 0.5 cont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
LC
LCO Embedding Omni 7B
Lco · marksverdhei
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 E2B It
Gemma · Joakimpalm-Zen
Params4.65B
Context128K
Q4_K_M2.6 GB
BG
BGE_M3_Mindspore
BGE · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
OP
openPangu Embedded 1B
Openpangu · mradermacher
Params1.16B
Context32K
Q4_K_M0.8 GB