Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
MU
multi qa MiniLM L6 cos v1
Multi · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
NO
Nomic Embed Text v1.5
Nomic · smarttasks
Params137M
Context2K
Q4_K_M0.1 GB
QW
Qwen3 Embedding 4B Bf16
Qwen · FILM6912
Params4.02B
Context40K
Q4_K_M2.5 GB
SN
Snowflake Arctic Embed S
Snowflake · thi3rrr
Params33M
Context512
Smallest0.0 GB
MS
Msmarco MiniLM L12 Cos v5
Msmarco · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
KU
KURE v1
Kure · Bingsu
Params567M
Context8K
Smallest0.6 GB
LA
lightonai lateon code edge f32
Lateon · embedme
Params17M
Context8K
Smallest0.1 GB
AR
Artemis 31B v1l GGUF Untied Embed
Artemis · Casual-Autopsy
Params32.1B
Context256K
Q4_K_M19.8 GB
AL
all MiniLM L6 v2
All · smarttasks
Params23M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 4B
Qwen · christian-winkler-th
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 Embedding 0.6b
Qwen · zw89
Params596M
Context32K
Smallest0.6 GB
BG
bge base en v1.5
BGE · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
NO
nomic embed text v2 moe GGUF Q8 0
Nomic · majentik
Params475M
Context2K
Smallest0.5 GB
NO
nomic embed code Q5 K M
Nomic · ExpedientFalcon
Params7.07B
Context32K
Smallest5.1 GB
CZ
czech semantic embeddings c
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
NO
nomic embed text v2 moe GGUF Q4 K M
Nomic · majentik
Params475M
Context2K
Q4_K_M0.4 GB
JI
Jina Reranker v2 Base Multilingual
Jina · sinjab
Params278M
Context1K
Q4_K_M0.2 GB
MI
RFC DRAlign QN
Mistral · jiebi
Params7.24B
Context32K
Smallest7.7 GB
BE
Beisen AI
Beisen · maxosai
Params1.84B
Context8K
Smallest2.0 GB
QW
Qwen3 VL Reranker 2B
Qwen · AhmedxSaad
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3 Reranker 0.6B
Qwen · philipp-zettl
Params596M
Context40K
Smallest0.6 GB
SN
Snowflake Arctic Embed M v1.5
Snowflake · yixuan-chia
Params109M
Context512
Q4_K_M0.1 GB
QW
Qwen3 Reranker 8B
Qwen · hugger7326
Params7.57B
Context40K
Smallest8.0 GB
GR
Granite Embedding
Granite · arshvir
Params312M
Context32K
Smallest0.6 GB
HA
Harrier Oss v1 0.6b
Harrier · Seneelya
Params596M
Context32K
Smallest0.6 GB
EM
embeddinggemma-300m
Embeddinggemma · confamnode
Params303M
Context2K
Q4_K_M0.2 GB
BG
bge m3 Q4 K M
BGE · VISHNUDHAT
Params567M
Context8K
Q4_K_M0.4 GB
NO
Nomic Embed Text v1.5
Nomic · zyj2003lj
Params137M
Context2K
Q4_K_M0.1 GB
RT
RTriever 4B
Rtriever · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
MS
Msmarco Distilbert Base Tas B
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB