Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
SN
snowflake arctic embed l
Snowflake · keisuke-miyako
Params334M
Context512
Smallest0.4 GB
BG
Bge Small En v1.5
BGE · nesall
Params33M
Context512
Smallest0.0 GB
QW
Qwen3 Embedding 0.6B
Qwen · Jgriosanz
Params596M
Context32K
Q4_K_M0.4 GB
GR
Granite Embedding English R2
Granite · fisher046
Params149M
Context8K
Smallest0.2 GB
BG
bge m3 Q8 0
BGE · wp-airik
Params567M
Context8K
Smallest0.6 GB
BG
bge reranker v2 m3
BGE · Keithsel
Params568M
Context8K
Smallest1.2 GB
GR
granite embedding 311m multilingual r2 F16
Granite · rodraco
Params312M
Context32K
Smallest0.6 GB
BG
bge m3 Q8 0
BGE · pyarn
Params567M
Context8K
Smallest0.6 GB
LL
Llama 3 1 Nemotron 51B Instruct Q3 K S with q6 K output and q8 embedding
Llama · GeorgyGUF
Params51.5B
Context128K
Smallest23.3 GB
QW
Qwen3 Reranker 8B
Qwen · redsquirrel
Params7.57B
Context40K
Q4_K_M4.7 GB
BG
bge m3 lemur r4
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
BG
Bge Large En v1.5
BGE · huoxu
Params334M
Context512
Smallest0.4 GB
SN
snowflake arctic embed m v1.5
Snowflake · keisuke-miyako
Params109M
Context512
Smallest0.1 GB
QW
lazynote qwen3 embedding
Qwen · unsig46
Params596M
Context32K
Q4_K_M0.4 GB
AL
all minilm l6 v2
All · volker-mauel
Params23M
Context512
Smallest0.0 GB
JI
Jina Code Embeddings 1.5b
Jina · herMaster
Params1.54B
Context32K
Smallest3.1 GB
SN
Snowflake Arctic Embed L v2.0
Snowflake · embedme
Params567M
Context8K
Smallest1.2 GB
BG
bge m3 doc r1
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
MX
Mxbai Embed Large v1
Mxbai · elliotsayes
Params334M
Context512
Q4_K_M0.2 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · mirekphd
Params1.78B
Context128K
Smallest1.9 GB
BG
bge m3 GGUF Q4 K M
BGE · deepsweet
Params567M
Context8K
Q4_K_M0.4 GB
BG
bge m3
BGE · OllmOne
Params567M
Context8K
Smallest0.6 GB
AN
Ankh3 Large
Ankh · introvoyz041
Params1.88B
Context512
Smallest1.1 GB
CO
lightonai colbert zero Q8 0
Colbert · embedme
Params149M
Context8K
Smallest0.2 GB
SM
SmolLM 135M Instruct DEVINator v0.2
SmolLM · unclemusclez
Params135M
Context2K
Smallest0.1 GB
GR
Granite Embedding 278m Multilingual
Granite · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
BG
bge reranker v2 m3 Q4 K M
BGE · fish22
Params568M
Context8K
Q4_K_M0.4 GB
QW
Qwen3 Embedding 0.6B Bf16
Qwen · MrDragonFox
Params596M
Context32K
Smallest0.6 GB
MA
ms marco TinyBERT L2 Q8 0
Marco · sinjab
Params4M
Context512
Smallest0.0 GB
UA
UAE-Large-V1
Uae · agier9
Params334M
Context512
Smallest0.2 GB