Dolphin GGUF models

95 GGUF models in the Dolphin family, quantized by 34 uploaders. Sizes run from 386M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DO
dolphin 24b
Dolphin · rashedul420
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DO
Dolphin R1 Cydonia v0.3 alt Q5 K M
Dolphin · harkov000
Params23.6B
Context32K
Smallest16.8 GB
Reasoning
DO
Dolphin Thinker Preview
Dolphin · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningTool use
DO
dolphin hermes stheno 8B v0.1 Q5 K M
Dolphin · harkov000
Params8.03B
Context128K
Smallest5.7 GB
Tool use
DO
dolphin custom
Dolphin · Vitesse544
Params7.5B
Context8K
Smallest15.0 GB
GGUF

Keep browsing