Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr speakleash 010 pl 3072 32 16 0.01
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-spo-full
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b dpo full ExPO
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr RMU
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · newsletter
Params7.24B
Context32K
Smallest5.9 GB
GGUF
ZE
Zephyr 7b Alpha
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr python ru merged
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b sft full SPIN iter3
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-beta-0.2
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B Norobots
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
ZE
zephyr-7b-DPOBS128-full
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr python ru
Zephyr · MexIvanov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b UC 0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-speakleash-007-pl-8192-32-16-0.05
Zephyr · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
hcl zephyr 7b javascript lotuscript
Zephyr · arvnoodle
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr_All_7B
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-bad-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr beta wizardLM 2 merge 7B
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Unsloth DPO
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-ensemble-mixv4
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 6b Dpo Full
Zephyr · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
ZE
zephyr-7b-hindsight-full
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-only-chosen-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr neural chat frankenmerge11b
Zephyr · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
GGUF
ZE
HuggingFaceH4 Zephyr 7b Alpha
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing