Embedding GGUF models

2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
Wisedom 8B EmbeddingReordering
Wisedom · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Embedding
KA
Kallamni Embed v1
Kallamni · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
BG
BGE Reranker v2 M3
BGE · Geofront
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
BG
bge small en
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
Embedding
LL
Hermes 3 Llama 3.1 8B TIES with base Embeds Initialized dtypeF32 OQ8 0 F32.EF32.IQ4 K Q8 0
Llama · Joseph717171
Params8.03B
Context128K
Smallest6.9 GB
EmbeddingTool use
BI
bidirlm omni 2.5b textonly
Bidirlm · cstr
Params1.72B
Context125K
Smallest1.1 GB
Embedding
QW
Qwen3 VL Embedding 2B
Qwen · alan314159
Params1.72B
Context256K
Smallest1.8 GB
EmbeddingVision
BG
BGE Medical
BGE · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
Embedding
ML
ML E5 0.3B
mradermacher
Params277M
Context512
Q4_K_M0.2 GB
Embedding
ZE
zen3 reranker medium
Zen · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
Embedding
NO
nomic-embed-text-v1.5
Nomic · keisuke-miyako
Params137M
Context2K
Smallest0.1 GB
Embedding
PH
Phi 3.5 instruct CBR Bonds info
Phi · winterForestStump
Params3.82B
Context128K
Q4_K_M2.3 GB
Embedding
DI
Distilbert Base Nli Stsb Quora Ranking
Distilbert · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Embedding
EM
Embeddinggemma 300m
Embeddinggemma · Bhuvneesh
Params303M
Context2K
Smallest0.3 GB
Embedding
BG
bge reranker v2 m3 Q4 K M
BGE · sikreutz
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
GT
Gte Reranker Modernbert Base
Gte · jolleyboy
Params150M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
PO
PolDense-17M
Poldense · kprzyb
Params17M
Context8K
Smallest0.0 GB
Embedding
BG
bge m3 query clients
BGE · thinletter
Params567M
Context8K
Q4_K_M0.4 GB
CodingEmbedding
DE
Desu Snowflake Arctic Embed L v2.0 Finetuned Amharic Final
Desu · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
PO
PolDense-150M
Poldense · kprzyb
Params149M
Context8K
Smallest0.2 GB
Embedding
SA
SauerkrautLM Multi ColBERT 33m
Sauerkrautlm · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
Embedding
BG
IMPETUS Climate bge small
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
Embedding
BE
Rosa-V1
Bert · willt-dc
Params109M
Context512
Smallest0.1 GB
Embedding
MM
mmarco mMiniLMv2 L12 H384 v1
Mminilmv · mono-of-pg
Params118M
Context512
Smallest0.5 GB
Embedding
MS
Msmarco Distilbert Dot v5
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · gscoppino
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
PO
PolDense-400M
Poldense · kprzyb
Params395M
Context8K
Smallest0.4 GB
Embedding
LL
F2LLM V2 8B
Llm · seamon67
Params7.57B
Context40K
Q4_K_M4.7 GB
CodingEmbeddingReasoning
OC
Octen Embedding 0.6B
Octen · mykor
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
MI
MiniLM v2 v28 SemanticEngine
Minilm · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
Embedding

Other uses

Keep browsing