Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
LL
BGE M3 Swahili
Llama · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
LL
Embedding Prune Llama 0.85B
Llama · mradermacher
Params850M
Context128K
Q4_K_M0.7 GB
QW
Qwen3 Reranker 4B
Qwen · bb4d92fe-605b-4484-a749-fc18e6e2f169
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 VL Embedding 8B
Qwen · ganeshrao
Params7.57B
Context256K
Q4_K_M4.7 GB
ME
medical 100 64 16 jinaai jina embeddings v2 small en 100 gpt 3.5 turbo 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
QW
Qwen3 VL Embedding 2B
Qwen · elVlad
Params1.72B
Context256K
Q4_K_M1.1 GB
BG
bge reranker base Q8 0
BGE · pyarn
Params278M
Context512
Smallest0.3 GB
RU
ruvltra
Ruvltra · Xlnk
Params494M
Context32K
Q4_K_M0.4 GB
ME
medical 20 0 16 jinaai jina embeddings v2 small en 1000 gpt 4 turbo 01 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
PA
Paraphrase Multilingual Mpnet Base v2
Paraphrase · sizrox
Params277M
Context512
Smallest0.3 GB
BG
bge m3 legal retrieval Q8 0
BGE · Sleem247
Params567M
Context8K
Smallest0.6 GB
LL
F2LLM v2 330M
Llm · yeahbeen
Params334M
Context40K
Q4_K_M0.3 GB
QW
Qwen3 Reranker 8B
Qwen · aotsukiqx
Params8.19B
Context40K
Smallest6.7 GB
OC
Octen Embedding 8B
Octen · seamon67
Params7.57B
Context40K
Q4_K_M4.7 GB
QW
Qwen3 Embedding 0.6B
Qwen · WariHima
Params596M
Context32K
Q4_K_M0.4 GB
QO
Qodo Embed 1 1.5B
Qodo · fuckoff11
Params1.54B
Context128K
Q4_K_M1.0 GB
MU
multilingual e5 base Q4 K M
Multilingual · Naresh
Params277M
Context512
Q4_K_M0.2 GB
LL
Llama3merge6 15B MoE
Llama · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
ZE
zerank 2 gguf q4 k m
Zerank · keisuke-miyako
Params4.02B
Context40K
Q4_K_M2.5 GB
JI
Jina Reranker v2 Base Multilingual
Jina · hugger7326
Params278M
Context1K
Smallest0.3 GB
KA
KaLM Reranker V1 Nano
Kalm · KaLM-Embedding
Params368M
Context32K
Q4_K_M0.3 GB
BG
bge reranker v2 m3 Q8 0
BGE · lei-zh
Params568M
Context8K
Smallest0.6 GB
JI
jina embeddings v2 base code Q4 K M
Jina · sabafallah
Params160M
Context8K
Q4_K_M0.1 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · niancheng
Params1.78B
Context128K
Q4_K_M1.1 GB
BG
bge reranker v2 m3 Q8 0
BGE · Astralyra
Params568M
Context8K
Smallest0.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · philipp-zettl
Params596M
Context32K
Smallest0.6 GB
MX
Mxbai Embed Large v1
Mxbai · VISHNUDHAT
Params334M
Context512
Q4_K_M0.2 GB
EM
Embeddinggemma 300m
Embeddinggemma · dispatchAI
Params308M
Context2K
Smallest0.3 GB
NO
CodeRankEmbed Q8 0
Nomic · BenevolenceMessiah
Params137M
Context2K
Smallest0.1 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · olegshulyakov
Params303M
Context2K
Smallest0.3 GB