Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
BC
Bce Reranker Base_V1
Bce · jfiekdjdk
Params278M
Context512
Q4_K_M0.2 GB
LL
Llama 3 1 Nemotron 51B Instruct Q3 K S with q8 output and embedding
Llama · GeorgyGUF
Params51.5B
Context128K
Smallest23.6 GB
MO
monas embeddings text code
Monas · trungvn2401s
Params3.09B
Context125K
Smallest3.3 GB
BG
bge m3 legal euro r21
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
BG
bge m3 doc r3
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
BG
bge m3 Q8 0
BGE · pqnet
Params567M
Context8K
Smallest0.6 GB
MA
ms marco TinyBERT L6 F16
Marco · sinjab
Params66M
Context512
Smallest0.1 GB
GT
Gte Base
Gte · sizzlebop
Params109M
Context512
Smallest0.1 GB
QW
Qwen3 Reranker 4B
Qwen · ReddaGlue
Params4.02B
Context40K
Smallest4.3 GB
GR
Granite Embedding 107m Multilingual
Granite · naver-ellm
Params107M
Context512
Q4_K_M0.1 GB
QW
Gte Qwen2 1.5B Instruct
Qwen · bytejack007
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
Deepset Mxbai Embed De Large v1
Deepset · Lemminger
Params486M
Context512
Smallest0.5 GB
NA
Namaa ARA Reranker V1 Q4 K M
Namaa · wahidmounir
Params568M
Context8K
Q4_K_M0.4 GB
QW
Qwen3 Embedding 4B F16
Qwen · rodraco
Params4.02B
Context40K
Smallest8.0 GB
EM
embedder
Embedder · LouisMclean
Params137M
Context2K
Smallest0.3 GB
LL
Llm Embedder
Llm · itskoi
Params109M
Context512
Q4_K_M0.1 GB
QW
gte-Qwen2-7B-instruct
Qwen · mirekphd
Params7.61B
Context128K
Smallest30.5 GB
ME
MedEmbed large v0.1
Medembed · amsaravi
Params334M
Context512
Smallest0.4 GB
GE
geo all MiniLM L6 v2
Geo · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
BG
bge m3 legal euro r6
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Reranker 0.6B
Qwen · kerncore
Params596M
Context40K
Q4_K_M0.4 GB
BG
bge m3 legal euro r15
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
BG
bge m3 legal euro r18
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
BG
bge m3 legal euro r20
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
AL
all MiniLM L12 v2 Q4 K M
All · iamahmadsaboor
Params33M
Context512
Q4_K_M0.0 GB
AL
all MiniLM L6 v2 Q8 0
All · nayanakto
Params23M
Context512
Smallest0.0 GB
DE
Deepset Mxbai Embed De Large v1
Deepset · AKI0284
Params486M
Context512
Smallest0.5 GB
JI
Jina Reranker v2 Base Multilingual
Jina · Aneeth
Params278M
Context1K
Smallest1.1 GB
XL
Xlm R Base En Ko Nli Ststb
Xlm · hongkeon
Params277M
Context512
Smallest0.3 GB
QW
Qwen3 NoThinkEmbed
Qwen · DESUCLUB
Params4.41B
Context40K
Smallest2.5 GB