Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite Embedding 107m Multilingual
Granite · lmstudio-community
Params107M
Context512
Q4_K_M0.1 GB
Embedding
JI
jina embeddings v2 base en
Jina · gaianet
Params137M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
GP
Gpt Neox 20b Embeddings
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · mradermacher
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
QW
Whittle Next 26B A3B
Qwen · whittleOrg
Params26.6B
Context256K
Smallest28.3 GB
EmbeddingReasoningTool use
GR
Granite Embedding 278m Multilingual
Granite · lmstudio-community
Params277M
Context512
Q4_K_M0.2 GB
Embedding
PP
Pplx Embed v1 0.6b
Pplx · mykor
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3 Embedding 0.6B GGUF Q8 0
Qwen · majentik
Params596M
Context32K
Smallest0.6 GB
EmbeddingReasoningTool use
NE
Nemotron 3 Embed 1B
Nemotron · nanoandrew4
Params1.14B
Context256K
Smallest1.2 GB
Embedding
MX
Mxbai Rerank Large v2
Mxbai · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
EmbeddingTool use
QW
LaSER Qwen3 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
EmbeddingTool use
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · ebasKing
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
QW
Qwen3-Reranker-0.6B
Qwen · gorse-io
Params596M
Context40K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
JI
jina embeddings v2 base en
Jina · gpustack
Params137M
Context8K
Q4_K_M0.1 GB
Embedding
GT
gte-base
Gte · ChristianAzinn
Params109M
Context512
Q4_K_M0.1 GB
Embedding
QW
colnomic embed multimodal 7b
Qwen · brishen
Params7.62B
Context125K
Q4_K_M4.7 GB
EmbeddingVision
NA
NayanaEmbed BiGemma3 Matryoshka 1500 v2
Nayanaembed · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
EmbeddingVision
JI
Jina Code Embeddings 0.5b
Jina · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CodingEmbedding
NO
nomic embed text 1.5
Nomic · lm-kit
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
GR
Granite Embedding 107m Multilingual
Granite · keisuke-miyako
Params107M
Context512
Smallest0.1 GB
Embedding
GT
Gte Large Zh
Gte · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
Embedding
GI
GIST-large-Embedding-v0
Gist · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
VY
Vyakyarth
Vyakyarth · mradermacher
Params277M
Context512
Q4_K_M0.2 GB
Embedding
ZE
Zerank 1 Small
Zerank · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingEmbeddingReasoning
PP
pplx embed v2 late 0.6b
Pplx · bigdawg003
Params494M
Context256K
Smallest0.5 GB
EmbeddingVision
GE
Matick Gemma 4 E2B Mexicano v3
Gemma · danymorlet
Params271M
Context128K
Q4_K_M3.4 GB
EmbeddingVision
MI
Mistral 7B Merge 14 v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
BG
Bge Large En v1.5
BGE · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
Embedding
MX
mxbai rerank base v2 i1
Mxbai · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
EmbeddingTool use

Other uses

Keep browsing