Embedding GGUF models
2342 GGUF models: embedding models for search and RAG. Sizes run from 1M to 671B parameters. The longest trained context is 1024K tokens.
WI
Wisedom 8B EmbeddingReordering
Wisedom · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
KA
Kallamni Embed v1
Kallamni · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
BG
BGE Reranker v2 M3
BGE · Geofront
Params568M
Context8K
Q4_K_M0.4 GB
BG
bge small en
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
LL
Hermes 3 Llama 3.1 8B TIES with base Embeds Initialized dtypeF32 OQ8 0 F32.EF32.IQ4 K Q8 0
Llama · Joseph717171
Params8.03B
Context128K
Smallest6.9 GB
BI
bidirlm omni 2.5b textonly
Bidirlm · cstr
Params1.72B
Context125K
Smallest1.1 GB
QW
Qwen3 VL Embedding 2B
Qwen · alan314159
Params1.72B
Context256K
Smallest1.8 GB
BG
BGE Medical
BGE · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
ML
ML E5 0.3B
mradermacher
Params277M
Context512
Q4_K_M0.2 GB
ZE
zen3 reranker medium
Zen · mradermacher
Params560M
Context512
Q4_K_M0.4 GB
NO
nomic-embed-text-v1.5
Nomic · keisuke-miyako
Params137M
Context2K
Smallest0.1 GB
PH
Phi 3.5 instruct CBR Bonds info
Phi · winterForestStump
Params3.82B
Context128K
Q4_K_M2.3 GB
DI
Distilbert Base Nli Stsb Quora Ranking
Distilbert · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
EM
Embeddinggemma 300m
Embeddinggemma · Bhuvneesh
Params303M
Context2K
Smallest0.3 GB
BG
bge reranker v2 m3 Q4 K M
BGE · sikreutz
Params568M
Context8K
Q4_K_M0.4 GB
GT
Gte Reranker Modernbert Base
Gte · jolleyboy
Params150M
Context8K
Q4_K_M0.1 GB
PO
PolDense-17M
Poldense · kprzyb
Params17M
Context8K
Smallest0.0 GB
BG
bge m3 query clients
BGE · thinletter
Params567M
Context8K
Q4_K_M0.4 GB
DE
Desu Snowflake Arctic Embed L v2.0 Finetuned Amharic Final
Desu · mradermacher
Params567M
Context8K
Q4_K_M0.4 GB
PO
PolDense-150M
Poldense · kprzyb
Params149M
Context8K
Smallest0.2 GB
SA
SauerkrautLM Multi ColBERT 33m
Sauerkrautlm · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
BG
IMPETUS Climate bge small
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
BE
Rosa-V1
Bert · willt-dc
Params109M
Context512
Smallest0.1 GB
MM
mmarco mMiniLMv2 L12 H384 v1
Mminilmv · mono-of-pg
Params118M
Context512
Smallest0.5 GB
MS
Msmarco Distilbert Dot v5
Msmarco · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · gscoppino
Params4.02B
Context40K
Q4_K_M2.5 GB
PO
PolDense-400M
Poldense · kprzyb
Params395M
Context8K
Smallest0.4 GB
LL
F2LLM V2 8B
Llm · seamon67
Params7.57B
Context40K
Q4_K_M4.7 GB
OC
Octen Embedding 0.6B
Octen · mykor
Params596M
Context32K
Q4_K_M0.4 GB
MI
MiniLM v2 v28 SemanticEngine
Minilm · mradermacher
Params23M
Context512
Q4_K_M0.0 GB