Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
NO
nomic embed text v2 moe Q8 0
Nomic · benvezzani
Params475M
Context512
Smallest0.5 GB
QW
Qwen3 Reranker 8B
Qwen · yaraksan
Params7.57B
Context40K
Q4_K_M4.7 GB
QW
Qwen3 Reranker 4B
Qwen · furyzhenxi
Params4.02B
Context40K
Smallest4.3 GB
QW
Qwen3 Embedding 4B
Qwen · grevinden
Params4.02B
Context40K
Smallest2.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · fisher046
Params596M
Context32K
Smallest1.2 GB
RE
Reranker Xlm Roberta Large
Reranker · jixaw
Params560M
Context512
Smallest0.6 GB
BG
bge reranker large Q4 K M
BGE · hedao
Params560M
Context512
Q4_K_M0.4 GB
QW
Qwen3 Embedding 4B
Qwen · binarypetal
Params4.02B
Context40K
Q4_K_M2.5 GB
SN
snowflake arctic embed xs
Snowflake · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
NO
CodeRankEmbed Q4 K M
Nomic · brandtcormorant
Params137M
Context2K
Q4_K_M0.1 GB
LL
Llama 3 1 Nemotron 51B Instruct Q3 K S with q6 K output and embedding and blk.79.attn out
Llama · GeorgyGUF
Params51.5B
Context128K
Smallest23.1 GB
QW
Gte Qwen2 1.5B Instruct
Qwen · miti99
Params1.78B
Context128K
Smallest1.9 GB
LA
lightonai lateon Q4 0
Lateon · embedme
Params149M
Context8K
Smallest0.1 GB
MU
multilingual e5 large Q4 K M
Multilingual · pruizpar
Params559M
Context512
Q4_K_M0.4 GB
BG
bge reranker large Q8 0
BGE · MOLUOKA
Params560M
Context512
Smallest0.6 GB
JI
jina embeddings v2 base es Q4 K M
Jina · AndreasX
Params160M
Context8K
Q4_K_M0.1 GB
BG
bge m3 ko v1.1 Q6 K
BGE · hongkeon
Params567M
Context8K
Smallest0.5 GB
EM
embeddinggemma 300M Q6 K
Embeddinggemma · nonstandarddeviant
Params308M
Context2K
Smallest0.3 GB
GR
granite embedding small english r2 gguf q8 0
Granite · keisuke-miyako
Params48M
Context8K
Smallest0.1 GB
LL
Llama-3-8B-ORPO
Llama · kingabzpro
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3 finance fine tuned
Llama · tw1883
Params8.03B
Context8K
Smallest16.1 GB
BG
bge reranker large gguf q8 0
BGE · keisuke-miyako
Params560M
Context512
Smallest0.6 GB
BC
Bce Embedding Base_V1
Bce · keisuke-miyako
Params277M
Context512
Smallest0.6 GB
GP
Gpt Neox 20b Embeddings
Gpt · quokka0614
Params20.6B
Context2K
Q4_K_M13.1 GB
BG
bge m3 Korean Judgment Transducer Verifier v1.1 Q8 0
BGE · hongkeon
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Reranker 0.6B
Qwen · johnniang
Params596M
Context40K
Q4_K_M0.4 GB
MA
ms marco TinyBERT L2 v2 F16
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
JI
jina reranker v1 tiny en Q4 K M
Jina · sinjab
Params33M
Context8K
Q4_K_M0.0 GB
BG
Bge m3_RAG Conversational IR
BGE · Sleem247
Params567M
Context8K
Smallest0.6 GB
AN
answerdotai jacolbertv2 5 proj extracted q8 0
Answerdotai · embedme
Params111M
Context512
Smallest0.1 GB