Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
TR
TrialSpace 0426
Trialspace · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
BE
Bert Base Nli Mean Tokens
Bert · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
SB
Sbert Nepali Sevabot
Sbert · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
TO
Tool Embed 0.6B
Tool · mradermacher
Params751M
Context32K
Q4_K_M0.5 GB
BG
bge reranker v2 m3 F16
BGE · sinjab
Params568M
Context8K
Smallest1.2 GB
BG
USER Bge M3
BGE · sparkhonyuk
Params358M
Context8K
Smallest0.3 GB
QW
Qwen3 Embedding 4b
Qwen · CompendiumLabs
Params4.02B
Context40K
Smallest2.9 GB
NO
Modernbert Embed
Nomic · keisuke-miyako
Params149M
Context8K
Smallest0.2 GB
NE
NeuroBERT Mini
Neurobert · Trkaga
Params11M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · ebasKing
Params7.57B
Context40K
Q4_K_M4.7 GB
SN
Snowflake Arctic Embed M
Snowflake · yixuan-chia
Params109M
Context512
Q4_K_M0.1 GB
QW
INFRL Qwen2.5 VL 72B Preview q8 with bf16 output and bf16 embedding
Qwen · GeorgyGUF
Params72.7B
Context125K
Smallest79.6 GB
JI
Jina Reranker v2 Base Multilingual
Jina · sinjab
Params278M
Context1K
Smallest0.6 GB
QW
Qwen3 Embedding 4B
Qwen · Chiwei
Params4.02B
Context40K
Q4_K_M2.5 GB
MI
SFR Embedding Mistral
Mistral · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Semantic Ar Qwen Embed 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EM
embeddinggemma-GTAIDE-300m-2605
Embeddinggemma · DavidLanz
Params308M
Context2K
Q4_K_M0.2 GB
MS
Msmarco Distilbert Base v4
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
SN
Snowflake Arctic Embed M Long
Snowflake · mradermacher
Params137M
Context2K
Q4_K_M0.1 GB
MU
multilingual e5 base
Multilingual · yixuan-chia
Params277M
Context512
Smallest0.3 GB
ZE
zen3 reranker
Zen · mradermacher
Params568M
Context8K
Q4_K_M0.4 GB
GT
Gte Reranker Modernbert Base
Gte · keisuke-miyako
Params150M
Context8K
Smallest0.2 GB
LL
Llama Embed Nemotron 8b
Llama · sabafallah
Params7.5B
Context128K
Q4_K_M4.6 GB
QW
Qwen3 Embedding 8B
Qwen · enacimie
Params7.57B
Context40K
Q4_K_M4.7 GB
NO
CodeRankEmbed
Nomic · handwoven8588
Params137M
Context2K
Smallest0.1 GB
AL
all MiniLM L6 v2 Q8 0
All · huoxu
Params23M
Context512
Smallest0.0 GB
BG
BGE m3 ko
BGE · CHKH01
Params567M
Context8K
Smallest0.6 GB
AB
Abel 7B 002 truncated embeds
Abel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MX
mxbai-embed-large-v1
Mxbai · magicunicorn
Params334M
Context512
Smallest0.4 GB
SP
spice
Spice · mradermacher
Params33M
Context512
Q4_K_M0.0 GB