All GGUF models

79 GGUF models in the All family, quantized by 56 uploaders. Sizes run from 23M to 17.3B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AL
all-MiniLM-L6-v2
All · aisuko
Params23M
Context512
Q4_K_M0.0 GB
GGUF
AL
all-MiniLM-L6-v2
All · ichi-kom
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
AL
All Q3 8B RP 0625
All · Disya
Params8.19B
Context32K
Smallest8.7 GB
ReasoningRoleplayTool use
AL
all minilm l6 v2 q8 0
All · synesterai
Params23M
Context512
Smallest0.0 GB
GGUF
AL
all MiniLM L6 v2 Q8 0
All · embedme
Params23M
Context512
Smallest0.0 GB
Embedding
AL
all MiniLM L6 v2 Q4 K M
All · z8086486
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
AL
all MiniLM L12 v2 Q4 K M
All · iamahmadsaboor
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding
AL
all MiniLM L6 v2 Q8 0
All · nayanakto
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
AL
all tool
All · azizshaw
Params3.21B
Context128K
Smallest6.4 GB
Tool use
AL
all MiniLM L6 v2 Q6 K
All · nesall
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
AL
Yi Ko 6B
All · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
AL
all MiniLM L12 v2 Q8 0
All · badger212
Params33M
Context512
Smallest0.0 GB
CodingEmbedding
AL
All_Merged
All · azizshaw
Params3.21B
Context128K
Smallest6.4 GB
Tool use
AL
all MiniLM L6 v2 Q4 K M
All · Lytchbaball
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
AL
all you need is
All · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AL
all MiniLM L12 v2 Q4 K M
All · sheldonrobinson
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding
AL
all models
All · jaxmetaverse
Params17.3B
Context—
Smallest12.3 GB
GGUF
AL
All Bots
All · DipaliLunge1
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
AL
All Q3 8B RP 0625
All · fengpeisheng1
Params8.19B
Context32K
Smallest4.8 GB
ReasoningRoleplayTool use
AL
all MiniLM L12 v2 Q4 K M
All · kalzero
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding

Keep browsing