Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
MX
Mxbai Embed Large v1
Mxbai · s3dev-ai
Params334M
Context512
Q4_K_M0.2 GB
MI
EmbeddedLLM Mistral 7B Merge 14 v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
SpaceEmbed Qwen3 0.6B
Qwen · llmlabcse
Params596M
Context32K
Smallest0.6 GB
QW
Gte Qwen2 1.5B Instruct
Qwen · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
OpenPangu Embedded 7B Medusa
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
CA
callbus emb 8b
Callbus · yasinyaman
Params8.19B
Context40K
Q4_K_M5.0 GB
DM
Dmeta Embedding Zh Small
Dmeta · mradermacher
Params74M
Context1K
Q4_K_M0.1 GB
BG
bge reranker base Q8 0
BGE · sinjab
Params278M
Context512
Smallest0.3 GB
GI
GIST Small Embedding v0
Gist · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
SK
SkillRouter Embedding 0.6B
Skillrouter · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
VI
Vietnamese_Embedding_v2
Vietnamese · tieubaoca
Params567M
Context8K
Smallest0.6 GB
FU
smartpanel functiongemma 270m
Functiongemma · BrinqAI
Params268M
Context32K
Q4_K_M0.3 GB
NO
NoInstruct Small Embedding v0
Noinstruct · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
LL
Meta Llama 3 8B InitializedEmbeds
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
BG
IMPETUS Climate bge small i1
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
BA
e5 base
Base · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
AL
all MiniLM L6 v2 Q8 0
All · sudomoniker
Params23M
Context512
Smallest0.0 GB
VI
Vietnamese_Reranker
Vietnamese · tieubaoca
Params568M
Context8K
Smallest0.6 GB
QW
Qwen3 Reranker 0.6B GGUF llama cpp
Qwen · zhiqian99
Params596M
Context40K
Q4_K_M0.4 GB
AS
Asena_Esp32
Asena · pthinc
Params1M
Context128
Q4_K_M0.0 GB
BG
Bge Micro
BGE · mradermacher
Params17M
Context512
Q4_K_M0.0 GB
QW
LaSER Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
TA
Taiyi CLIP RoBERTa 102M ViT L Chinese
Taiyi · mradermacher
Params102M
Context512
Q4_K_M0.1 GB
MS
Msmarco Distilbert Cos v5
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
BE
123BERT
Bert · mradermacher
Params9M
Context512
Q4_K_M0.0 GB
ST
Bert Tiny
Stsb · mradermacher
Params4M
Context512
Q4_K_M0.0 GB
LL
Llama 3 8B Fixed Special Embedding
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
AM
Amagasaki Qna Embedding 0.6B
Amagasaki · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen Qwen3 Embedding 0.6B
Qwen · batiai
Params596M
Context32K
Smallest0.5 GB
QW
Qwen3 Embedding 0.6B Bf16
Qwen · yomir
Params596M
Context32K
Smallest0.6 GB