Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Embedding 4B
Qwen · Fastiraz
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingTool use
QW
Qwen3 Embedding 0.6B
Qwen · bullerwins
Params596M
Context32K
Smallest0.6 GB
EmbeddingReasoningTool use
KA
KaLM Reranker V1 Large
Kalm · KaLM-Embedding
Params7.09B
Context128K
Q4_K_M4.5 GB
CodingEmbedding
QW
Qwen3 VL Reranker 2B
Qwen · turingevo
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
BG
bge reranker v2 m3
BGE · miharubajp
Params568M
Context8K
Smallest1.2 GB
Embedding
AL
all-MiniLM-L6-v2
All · gaianet
Params23M
Context512
Smallest0.0 GB
Embedding
BG
Bge Reranker v2 M3
BGE · huydt
Params568M
Context8K
Smallest0.6 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · philipp-zettl
Params303M
Context2K
Smallest0.3 GB
Embedding
QW
Qwen3 Embedding 0.6B
Qwen · sabafallah
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
QW
Qwen3 Embedding 8B GGUF Q8 0
Qwen · majentik
Params7.57B
Context40K
Smallest8.0 GB
EmbeddingTool use
MX
Mxbai Rerank Base v2
Mxbai · fuckoff11
Params494M
Context32K
Q4_K_M0.4 GB
EmbeddingTool use
MU
multilingual e5 large instruct
Multilingual · Impulse2000
Params559M
Context512
Smallest0.6 GB
Embedding
QW
Qwen3 Embedding 0.6B
Qwen · alst10
Params596M
Context32K
Smallest0.3 GB
EmbeddingReasoningTool use
QW
Qwen3 Embedding 0.6B
Qwen · Gwriiuuu
Params596M
Context32K
Smallest0.6 GB
EmbeddingReasoningTool use
MI
EmbeddedLLM Mistral 7B Merge 14 v0.5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · SandLogicTechnologies
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
QW
Gte Qwen2 7B Instruct
Qwen · wencan-lab
Params7.61B
Context128K
Q4_K_M4.7 GB
Embedding
GR
Granite Embedding English R2
Granite · phoenix-gurl
Params149M
Context8K
Smallest0.2 GB
Embedding
MI
sfr embedding mistral
Mistral · cminja
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
GR
granite embedding 311m multilingual r2
Granite · trithemius
Params312M
Context32K
Smallest0.6 GB
Embedding
QW
Qwen3 Embedding 8B NVFP4
Qwen · amkdg
Params8.19B
Context40K
Smallest6.4 GB
EmbeddingTool use
QW
Qwen3 Reranker 4B
Qwen · novelaide
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
JI
jina reranker v1 turbo en F16
Jina · sinjab
Params38M
Context8K
Smallest0.1 GB
Embedding
BG
bge m3 embeddings Q4 K M
BGE · Forrint
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
OP
openPangu Embedded 7B V1.1
Openpangu · holahola2023
Params8.03B
Context32K
Smallest4.7 GB
Embedding
QW
Qwen3 Reranker 8B
Qwen · christian-winkler-th
Params7.57B
Context40K
Q4_K_M4.7 GB
EmbeddingReasoningTool use
QW
Qwen3 Reranker 4B
Qwen · endyjasmi
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
AL
OGAI Embedder
All · GainEnergy
Params23M
Context512
Smallest0.0 GB
Embedding
GR
Granite Embedding 278m Multilingual
Granite · stefanberger
Params277M
Context512
Q4_K_M0.2 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · philipp-zettl
Params303M
Context2K
Q4_K_M0.2 GB
Embedding

Other uses

Keep browsing