Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
Embedding
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · Voodisss
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
CodingEmbedding
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
Embedding
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen3 Reranker 0.6B GGUF llama cpp
Qwen · Voodisss
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
BG
bge m3
BGE · lm-kit
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
QW
Qwen.Qwen3 VL Embedding 2B
Qwen · DevQuasar
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
EmbeddingVision
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
LF
LFM2.5 Embedding 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
Embedding
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
EmbeddingVision
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
ME
Medgemma 27b It
Medgemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
MU
multilingual e5 small
Multilingual · cstr
Params118M
Context512
Smallest0.1 GB
Embedding
JI
Jina Embeddings v5 Text Small Classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
JI
jina embeddings v4 text retrieval
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
EmbeddingVision
JI
Jina Embeddings v5 Text Small Text Matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.8 Flash Next
Qwen · Cyronius
Params132B
Context256K
Smallest64.8 GB
Embedding
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
Embedding
QW
Qwen3 VL Embedding 8B
Qwen · mradermacher
Params7.57B
Context256K
Q4_K_M4.7 GB
EmbeddingVision
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
JI
Jina Embeddings v5 Text Small Clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
CodingEmbeddingTool use

Other uses

Keep browsing