Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
Zephyr 7B DICE Iter1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B WPO FP
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-beta-nf4-fp16-upscaled
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr0 7b ultra dpo
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b iso29148
Zephyr · moussa021984
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b sft full
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr config agent 3
Zephyr · ccaug
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
UCLA-AGI/zephyr-7b-sft-full-SPIN-iter3
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr neural chat frankenmerge11b gguf q5
Zephyr · S4sch
Params11.4B
Context32K
Smallest8.0 GB
GGUF
ZE
Zephyr 7B alpha
Zephyr · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b sft full i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b sft full orpo
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
huggingfaceh4_zephyr-7b-beta
Zephyr · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Weyaxi/zephyr-beta-Nebula-v2-7B
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b q4 k m
Zephyr · ekshat
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 220m sft full
Zephyr · tensorblock
Params218M
Context2K
Smallest0.1 GB
GGUF
ZE
Weyaxi Zephyr Beta Nebula v2 7B
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr full dpo
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Jingyeom Zephyr_All_7B
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
l6 zephyr q4 k m
Zephyr · rasaHusen
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b sft full
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr dpo fast
Zephyr · BarraHome
Params7.24B
Context32K
Smallest5.0 GB
GGUF
ZE
Zephyr 7B Beta Helpful
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B beta pl
Zephyr · SinpxAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
ToxicMist v0.2 7B DPO
Zephyr · akaistormherald
Params7.24B
Context32K
Smallest4.1 GB
GGUF
ZE
zephyr-7b-dpo-full-ensemble-mixv3
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b dpo full
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing