Dolphin GGUF models

95 GGUF models in the Dolphin family, quantized by 34 uploaders. Sizes run from 386M to 69B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DO
Dolphin 5.1 7b i1
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DO
Dolphin v2 8b Abliterated
Dolphin · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
DO
dolphin-ultrafeedback-dpo
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin X1 Trinity Nano
Dolphin · mradermacher
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
DO
Dolphin 2.8 slerp i1
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin3 Cyber MalwareAnalyst
Dolphin · RavichandranJ
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin 2.8 Experiment26 7b
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
DO
Dolphin Cyber Arabic Merged
Dolphin · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DO
L3-8B-dolphin-2.9.1-WritingPrompts
Dolphin · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin 2.8 Experiment26 7b Preview
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
L3-8B-dolphin-2.9.1-WritingPrompts
Dolphin · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin3 8B
Dolphin · issam07425
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DO
Dolphin 2.8 slerp
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin 5.1 7b
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DO
Dolphin Xgen RL
Dolphin · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
DO
Dolphin 2.8 Experiment26 7B
Dolphin · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
DO
Dolphin2.1-OpenOrca-7B
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin X1 8B
Dolphin · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DO
nothingiisreal/L3-8B-dolphin-2.9.1-WritingPrompts
Dolphin · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin-2.8-slerp
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin 2.1 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DO
Dolphin-Nebula-7B
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
dolphin-hermes-stone-l3-8b-1m
Dolphin · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
Tool use
DO
dolphin laserxtral 4x7B i1
Dolphin · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
DO
Dolphin R1 Cydonia v0.2 i1
Dolphin · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
DO
Dolphin 2.7 Yayi2 30b
Dolphin · mradermacher
Params30.4B
Context8K
Q4_K_M18.2 GB
GGUF
DO
dolphin 2.8 experiment26 7b
Dolphin · macadeliccc
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin Xgen RL
Dolphin · noctrex
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
DO
dolphin star
Dolphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolphin 2.8 slerp
Dolphin · pabloce
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing