Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
JI
Jina Embeddings v5 Text Small Retrieval
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
ST
StrangeMerges 45 7B dare ties
Strangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Daredevil 7B
Daredevil · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LA
LateOn
Lateon · mradermacher
Params149M
Context8K
Q4_K_M0.1 GB
GE
bge reranker v2 gemma i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
VI
Vietlegal Harrier 0.6b
Vietlegal · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
ZE
Zen Reranker
Zen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
MU
multilingual e5 base Q8 0
Multilingual · dinab
Params277M
Context512
Smallest0.3 GB
EM
Embeddinggemma 2
Embeddinggemma · empyrealworks
Params271M
Context256K
Smallest0.2 GB
MO
MoAI Embedding 0.6B
Moai · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
LF
LFM2.5 2.6B Pashto Zi B
Lfm · nassimjp
Params2.69B
Context128K
Q4_K_M1.7 GB
BG
bge m3 Q4 K M
BGE · groonga
Params567M
Context8K
Q4_K_M0.4 GB
BG
German RAG BGE M3 MERGED X SNOWFLAKE ARCTIC HESSIAN AI
BGE · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
ME
MedEmbed base v0.1
Medembed · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GG
gguf jina reranker v1 tiny en
Gguf · Felladrin
Params33M
Context8K
Q4_K_M0.0 GB
GT
Gte Small
Gte · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
MU
Multilingual Text Semantic Search Siamese BERT V1
Multilingual · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
QW
jbaron34 Qwen2.5 0.5b bebop reranker new small
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3 Embedding 0.6B
Qwen · smarttasks
Params596M
Context32K
Q4_K_M0.4 GB
QW
VirbiusGuard 4B
Qwen · i1see1you
Params4.02B
Context32K
Q4_K_M2.5 GB
GI
GIST-small-Embedding-v0
Gist · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
QW
Qwen3 0.6B Accabot
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
LL
llama nemotron rerank 1b v2
Llama · kread
Params1.24B
Context128K
Smallest1.3 GB
SK
SkillReason Reranker 4b
Skillreason · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
BA
e5 base v2 i1
Base · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
WE
WeMM Embedding 4B
Wemm · seamon67
Params4.21B
Context256K
Smallest4.5 GB
WE
WeMM Embedding 2B
Wemm · lainsoykaf
Params2.39B
Context256K
Q4_K_M1.6 GB
EX
EXLLM 0.005B LMStudio Bytefallback
Exllm · ToTo-40417
Params5M
Context512
Smallest0.0 GB
QW
Qwen3 Embedding 0.6B
Qwen · zhiqian99
Params596M
Context32K
Q4_K_M0.4 GB
TR
Tropicals T1
Tropicals · mradermacher
Params102M
Context512
Q4_K_M0.1 GB