Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
jina embeddings v2 base es
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
JI
jina embeddings v5 omni nano retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingVision
EM
EmbeddingGemma 300m
Embeddinggemma · lmstudio-community
Params303M
Context2K
Smallest0.2 GB
Embedding
EM
Embeddinggemma 2
Embeddinggemma · prithivMLmods
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
ZE
Zerank 1
Zerank · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
CodingEmbedding
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
NO
nomic embed code i1
Nomic · mradermacher
Params7.07B
Context32K
Q4_K_M4.4 GB
CodingEmbeddingTool use
GT
UsefulLocalModels
Gte · freeideas
Params4.33B
Context256K
Q4_K_M2.8 GB
EmbeddingReasoningTool use
QW
Qwen3 Reranker 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
Embedding
EV
EventTwin
Eventtwin · mradermacher
Params568M
Context8K
Q4_K_M0.4 GB
CodingEmbedding
JI
jina embeddings v5 omni nano clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingReasoningTool use
EM
Embeddinggemma 2
Embeddinggemma · BennyDaBall
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
MI
embeddedllm_mistral-7b-merge-14-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
QW
Qwen3 Embedding 8B
Qwen · mradermacher
Params7.57B
Context40K
Q4_K_M4.7 GB
Embedding
SW
SwedishBeagle-dare
Swedishbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingEmbedding
QW
Qwen3 Embedding 0.6B
Qwen · moeshawky
Params596M
Context32K
Smallest0.6 GB
CodingEmbeddingReasoning
GE
Gemma 2 Mitra E
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Embedding
QW
Qwen3.8 Whittle Next 19.8B A10B base
Qwen · logic65
Params19.8B
Context256K
Q4_K_M13.2 GB
Embedding
JI
Jina Embeddings v4 Vllm Retrieval
Jina · mradermacher
Params3.1B
Context125K
Q4_K_M1.9 GB
Embedding
GR
Granite Embedding 30m English
Granite · bartowski
Params30M
Context512
Q4_K_M0.0 GB
Embedding
OC
Octen Embedding 8B
Octen · mradermacher
Params7.57B
Context40K
Q4_K_M4.7 GB
EmbeddingTool use
GT
gte-large
Gte · ChristianAzinn
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen3 Reranker 8b
Qwen · rugmunchmedia
Params7.57B
Context40K
Q4_K_M4.7 GB
CodingEmbeddingReasoning
GR
Granite Embedding 97m Multilingual R2
Granite · mykor
Params97M
Context32K
Q4_K_M0.1 GB
Embedding
QW
Qwen3 Embedding 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
JI
jina embeddings v2 base de
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
BI
bitnet embedding 0.6b
Bitnet · microsoft
Params596M
Context32K
Smallest0.4 GB
Embedding
MU
multilingual e5 base Q4 K M
Multilingual · dinab
Params277M
Context512
Q4_K_M0.2 GB
Embedding

Other uses

Keep browsing