Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
BG
bge m3
BGE · mykor
Params567M
Context8K
Q4_K_M0.4 GB
CA
CatMarcoro14 7B slerp
Catmarcoro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Gme Qwen2 VL 2B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
BG
Bge Large Zh v1.5
BGE · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
QW
Qwen3-Reranker-0.6B
Qwen · dengcao
Params596M
Context40K
Smallest0.6 GB
LI
lightblue reranker 0.5 cont filt 7max
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
QW
Qwen3 Embedding 4B
Qwen · Casual-Autopsy
Params4.02B
Context40K
Q4_K_M2.5 GB
OT
OTel Embedding 0.6B
Otel · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
QW
Giga Embeddings Instruct 480M 0826 Qwen3
Qwen · rad0main
Params484M
Context8K
Smallest0.5 GB
SN
Snowflake Arctic Embed S
Snowflake · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 0.6B
Qwen · giladgd
Params596M
Context40K
Q4_K_M0.4 GB
LL
f2llm v2 0.6b
Llm · cstr
Params596M
Context40K
Smallest0.4 GB
QW
Qwen3 VL Embedding 2B
Qwen · Rizwan313
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3-Coder-Next-DFlash
Qwen · Anbeeld
Params474M
Context256K
Q4_K_M0.3 GB
MX
Mxbai Rerank Large v2
Mxbai · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
JI
jina embeddings v2 base code
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
RE
lightblue.lb reranker 0.5B v1.0
Reranker · DevQuasar-6
Params494M
Context32K
Q4_K_M0.4 GB
ZE
Zerank 1
Zerank · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ZE
Zerank 2
Zerank · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
WE
WeMM Embedding GGUF Q4 K M
Wemm · TuTuCSF
Params2.39B
Context256K
Q4_K_M1.6 GB
LF
LFM2.5 2.6B Pashto Zi B
Lfm · mradermacher
Params2.69B
Context128K
Q4_K_M1.7 GB
QW
Qwen3 Embedding 0.6B
Qwen · n24q02m
Params596M
Context32K
Smallest0.4 GB
QW
Qwen.Qwen3 Reranker 8B
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
ME
Medgemma 27b It
Medgemma · gabriellarson
Params27B
Context128K
Q4_K_M16.5 GB
NE
Nemotron 3 Embed 1B BF16
Nemotron · NeoRoth
Params1.14B
Context256K
Q4_K_M0.7 GB
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
JI
jina v5 small
Jina · cstr
Params596M
Context32K
Smallest0.4 GB
FI
Finance Embeddings Investopedia
Finance · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
MX
mxbai rerank base v1
Mxbai · cstr
Params184M
Context512
Smallest0.2 GB
QW
Qwen3.5-35B-A3B-DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB