Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
MA
ms marco MiniLM L12 v2 F16
Marco · sinjab
Params33M
Context512
Smallest0.1 GB
MA
ms marco TinyBERT L4 F16
Marco · sinjab
Params14M
Context512
Smallest0.0 GB
QW
Qwen3 Reranker 0.6B
Qwen · hugger7326
Params596M
Context40K
Smallest0.6 GB
AC
Acge_Text_Embedding
Acge · bnightning
Params325M
Context1K
Q4_K_M0.2 GB
BG
bge m3 Q4 K M
BGE · HossamElkordi
Params567M
Context8K
Q4_K_M0.4 GB
QW
Qwen3 Embedding 0.6B
Qwen · wp-airik
Params596M
Context32K
Smallest0.6 GB
BG
bge reranker v2 m3 Q8 0
BGE · darrowoflykos
Params568M
Context8K
Smallest0.6 GB
NO
nomic embed text v2 moe Q8 0
Nomic · pyarn
Params475M
Context512
Smallest0.5 GB
AL
all MiniLM L6 v2 Q4 K M
All · dsouza889
Params23M
Context512
Q4_K_M0.0 GB
GR
Granite Embedding Small English R2
Granite · mrutkows
Params48M
Context8K
Smallest0.1 GB
AL
all MiniLM L6 v2 Q4 K M
All · enacimie
Params23M
Context512
Q4_K_M0.0 GB
KO
KoE5 Q8 0
Koe · coolsoon
Params559M
Context512
Smallest0.6 GB
HO
Hourai2 10m Embedding
Hourai · WariHima
Params10M
Context32K
Smallest0.0 GB
AL
all MiniLM L6 v2 Q8 0
All · sheldonrobinson
Params23M
Context512
Smallest0.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B Checkpoint 600 Reasoning Embedding
DeepSeek · Sleem247
Params1.54B
Context128K
Smallest1.6 GB
ZE
Zerank 2 Reranker
Zerank · Bearserker
Params4.02B
Context40K
Smallest1.9 GB
AL
all-MiniLM-L6-v2
All · technotic
Params23M
Context512
Smallest0.0 GB
BG
bge-large-en-v1.5
BGE · gaianet
Params334M
Context512
Smallest0.2 GB
BG
bge m3 legal euro r5
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Embedding 0.6B
Qwen · andquant
Params596M
Context32K
Smallest0.6 GB
HA
harrier oss v1 0.6b gguf f16
Harrier · 0x221A
Params596M
Context32K
Smallest1.2 GB
XI
Xiaobu Embedding v2
Xiaobu · msc802
Params324M
Context512
Smallest0.2 GB
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · Xilinbei
Params303M
Context2K
Smallest0.3 GB
YU
Yuan Embedding 2.0 Zh
Yuan · namemane
Params324M
Context512
Smallest0.3 GB
BA
e5 base v2 Q8 0
Base · velyan
Params109M
Context512
Smallest0.1 GB
OL
ollama vietnamese embedding test v3
Ollama · VietAnh12468
Params7.57B
Context40K
Smallest8.0 GB
QW
Qwen3 Embedding 0.6b
Qwen · carlosfundora
Params596M
Context32K
Smallest0.6 GB
BG
bge m3 legal euro r3
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
QW
Qwen3 Embedding 4B
Qwen · Chiwei
Params4.02B
Context40K
Smallest2.4 GB
NO
Nomic Embed Text v1.5
Nomic · blissie
Params137M
Context2K
Smallest0.1 GB