Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
jina embeddings v4 text matching
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
Embedding
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
JI
Jina Reranker v3.5
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
Embedding
CL
CLM v0.1 8B
Clm · czl
Params8.19B
Context40K
Q4_K_M5.0 GB
Embedding
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
Embedding
EM
embeddinggemma-2
Embeddinggemma · AtomicChat
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
EM
Embeddinggemma 300M Qat Q4_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
Embedding
JI
jina embeddings v2 base code
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · Voodisss
Params7.57B
Context40K
Q4_K_M4.7 GB
Embedding
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingTool useVision
NE
Nemotron 3.5 Embed 1B BF16
Nemotron · W4D
Params1.14B
Context256K
Q4_K_M0.7 GB
EmbeddingVision
OP
openPangu Embedded 7B V1.1
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
Embedding
NO
nomic ai nomic embed code
Nomic · bartowski
Params7.1B
Context32K
Q4_K_M4.4 GB
CodingEmbedding
LL
LLaVA-NeXT-Video-7B-DPO
LLaVA · ManishThota
Params6.74B
Context4K
Smallest7.2 GB
EmbeddingVision
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
Embedding
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
CodingEmbeddingReasoning
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
CodingEmbedding
QW
Qwen3.6 35B A3B DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB
CodingEmbedding
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
AA
aac pictogram retriever ptbr
Aac · Papuguinho
Params155M
Context2K
Q4_K_M0.1 GB
Embedding
OP
openPangu Embedded 7B V1.1
Openpangu · noctrex
Params8.03B
Context32K
Q4_K_M4.9 GB
Embedding
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
JI
jina embeddings v4 text code
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
CodingEmbedding
NO
Nomic Embed Text V2
Nomic · ggml-org
Params475M
Context2K
Smallest0.5 GB
Embedding
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB
Embedding

Other uses

Keep browsing