Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
JI
jina embeddings v4 text matching
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
Jina Reranker v3.5
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
CL
CLM v0.1 8B
Clm · czl
Params8.19B
Context40K
Q4_K_M5.0 GB
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
EM
embeddinggemma-2
Embeddinggemma · AtomicChat
Params271M
Context256K
Q4_K_M0.2 GB
EM
Embeddinggemma 300M Qat Q4_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
JI
jina embeddings v2 base code
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · Voodisss
Params7.57B
Context40K
Q4_K_M4.7 GB
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
NE
Nemotron 3.5 Embed 1B BF16
Nemotron · W4D
Params1.14B
Context256K
Q4_K_M0.7 GB
OP
openPangu Embedded 7B V1.1
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
NO
nomic ai nomic embed code
Nomic · bartowski
Params7.1B
Context32K
Q4_K_M4.4 GB
LL
LLaVA-NeXT-Video-7B-DPO
LLaVA · ManishThota
Params6.74B
Context4K
Smallest7.2 GB
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
AA
aac pictogram retriever ptbr
Aac · Papuguinho
Params155M
Context2K
Q4_K_M0.1 GB
OP
openPangu Embedded 7B V1.1
Openpangu · noctrex
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
JI
jina embeddings v4 text code
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
NO
Nomic Embed Text V2
Nomic · ggml-org
Params475M
Context2K
Smallest0.5 GB
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB