Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
TH
Thaki CiteRank 4B
Thaki · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 Embedding 4B Bf16
Qwen · Mungert
Params4.02B
Context40K
Q4_K_M2.5 GB
BG
bge reranker v2 m3 Q8 0
BGE · pqnet
Params568M
Context8K
Smallest0.6 GB
QW
ITER Qwen3 Embedding 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
GP
Gpt Neox 20b Embeddings
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
LF
Supra Title 350M exp
Lfm · SupraLabs
Params354M
Context125K
Q4_K_M0.2 GB
BG
bge-base-zh-v1.5
BGE · CompendiumLabs
Params102M
Context512
Q4_K_M0.1 GB
EM
Embeddinggemma 300m
Embeddinggemma · second-state
Params303M
Context2K
Q4_K_M0.2 GB
EM
embeddinggemma 300m GGUF with dense modules
Embeddinggemma · cduk
Params308M
Context2K
Smallest0.2 GB
ME
MedEmb 2B
Medemb · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
KA
Kanana 2 1.3b Embedding
Kanana · mykor
Params1.29B
Context4K
Q4_K_M0.9 GB
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
QW
gte-Qwen2-7B-instruct
Qwen · sunzx0810
Params7.61B
Context128K
Smallest5.4 GB
QW
Qwen.Qwen3 Reranker 0.6B
Qwen · DevQuasar
Params596M
Context40K
Q4_K_M0.4 GB
BG
bge reranker v2 m3
BGE · smarttasks
Params568M
Context8K
Q4_K_M0.4 GB
RA
rank1 14b
Rank · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
jbaron34 Qwen2.5 0.5b bebop reranker
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
KA
Kanana 2 3b Embedding
Kanana · mykor
Params3.18B
Context4K
Q4_K_M2.0 GB
CN
cnmoro TinyLlama ContextQuestionPair Classifier Reranker
Cnmoro · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
BG
baai bge m3 568m
BGE · cPilotGod
Params567M
Context8K
Q4_K_M0.4 GB
GR
granite embedding 311m multilingual r2
Granite · sonalect
Params312M
Context32K
Smallest0.0 GB
JI
jina embeddings v2 base zh
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
GM
GME VARCO VISION Embedding
Gme · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 Reranker 0.6B
Qwen · QuantFactory
Params751M
Context40K
Q4_K_M0.5 GB
QW
nomic-embed-code
Qwen · Mungert
Params7.07B
Context32K
Q4_K_M4.3 GB
QW
Qwen Indic v1
Qwen · mradermacher
Params7.57B
Context40K
Q4_K_M4.7 GB
DN
DNA VL STEER 2B
Dna · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EM
embeddinggemma 2
Embeddinggemma · yan2026
Params271M
Context256K
Q4_K_M0.2 GB
GT
Gte Large Zh
Gte · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
DA
Dare k 7B ties
Dare · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB