Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MX
mxbai-embed-large-v1
Mxbai · mixedbread-ai
Params334M
Context512
Smallest0.7 GB
Embedding
NO
nomic-embed-text-v1.5
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · ggml-org
Params308M
Context2K
Smallest0.3 GB
Embedding
BG
bge small en v1.5
BGE · unsloth
Params33M
Context512
Smallest0.1 GB
Embedding
MX
mxbai-embed-large-v1
Mxbai · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
BG
bge-small-en-v1.5
BGE · CompendiumLabs
Params33M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3 Embedding 0.6b
Qwen · Qwen
Params596M
Context32K
Smallest0.6 GB
Embedding
AL
all-MiniLM-L6-v2
All · second-state
Params23M
Context512
Q4_K_M0.0 GB
Embedding
AL
all-MiniLM-L6-v2
All · leliuga
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
NE
Nemotron 3 Embed 8B BF16
Nemotron · Abiray
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
SN
snowflake arctic embed m v1.5
Snowflake · Snowflake
Params109M
Context512
Smallest0.1 GB
Embedding
BG
bge-large-en-v1.5
BGE · CompendiumLabs
Params334M
Context512
Q4_K_M0.2 GB
Embedding
BG
bge-base-en-v1.5
BGE · CompendiumLabs
Params109M
Context512
Q4_K_M0.1 GB
Embedding
QW
Qwen3 Reranker 0.6B
Qwen · ggml-org
Params596M
Context40K
Smallest0.6 GB
Embedding
EM
embeddinggemma-2
Embeddinggemma · ggml-org
Params271M
Context256K
Smallest0.3 GB
EmbeddingVision
NE
Nemotron 3 Embed 1B Q4 K M
Nemotron · zenmagnets
Params1.14B
Context256K
Q4_K_M0.7 GB
Embedding
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
Embedding
BG
bge m3
BGE · gpustack
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 Embedding 4B
Qwen · Qwen
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
JI
Jina Embeddings v5 Text Nano Retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
JI
Jina Embeddings v5 Text Small Retrieval
Jina · jinaai
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 Embedding 8B
Qwen · Qwen
Params7.57B
Context40K
Q4_K_M4.7 GB
Embedding
SE
Sentence Bert Swedish Cased
Sentence · KBLab
Params124M
Context512
Smallest0.3 GB
Embedding
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
Embedding
MX
mxbai embed xsmall v1
Mxbai · mixedbread-ai
Params24M
Context4K
Smallest0.0 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · ente-ai
Params308M
Context2K
Smallest0.3 GB
Embedding
BG
bge reranker v2 m3
BGE · gpustack
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
Embedding
JI
jina reranker v1 tiny en
Jina · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding

About Embedding GGUF models

2,342 GGUF models are filed under Embedding: embedding models for search and RAG. The most downloaded are mxbai-embed-large-v1, nomic-embed-text-v1.5 and Embeddinggemma 300m. Parameter counts run from 1M to 671B, and the longest trained context window is 1024K tokens.

Embedding models turn text into vectors for search and retrieval. They are small, and you use them through an embeddings endpoint instead of a chat prompt. The families you will see most are Qwen (519), BGE (291) and Jina (102).

Frequently asked questions

What are Embedding GGUF models?

Embedding models for search and RAG. There are 2,342 of them on this site.

Which Embedding GGUF model should I start with?

The most downloaded is mxbai-embed-large-v1. Choose the size that fits your GPU, then a Q4_K_M quant unless you have memory to spare.

Other uses

Keep browsing