Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
Zephyr-3.43B
Zephyr · afrideva
Params3.43B
Context4K
Q4_K_M2.1 GB
GGUF
ZE
zephyr 220m sft full
Zephyr · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
ZE
zephyr 7b sft full SPIN iter3 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b dpo full i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter3 v0
Zephyr · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B Alpha
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta_Bio Tutor_Dpo
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr dpo v2 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-beta
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-full-ut-sft
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B WPO FP
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter3 v0 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B Beta
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-fcxoywi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr Saul Base 7b merged
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.2B
Context128K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-bad
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter1 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter2 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-xlkdlta
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-beta-Nebula-v2-7B
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-judge-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 6b Dpo Full
Zephyr · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF

Keep browsing