Zephyr GGUF models
250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.
ZE
Zephyr-3.43B
Zephyr · afrideva
Params3.43B
Context4K
Q4_K_M2.1 GB
ZE
zephyr 220m sft full
Zephyr · afrideva
Params218M
Context2K
Q4_K_M0.1 GB
ZE
zephyr 7b sft full SPIN iter3 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b dpo full i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b spin iter3 v0
Zephyr · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7B Alpha
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Beta_Bio Tutor_Dpo
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr dpo v2 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-beta
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-full-ut-sft
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7B WPO FP
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b spin iter3 v0 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7B Beta
Zephyr · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-fcxoywi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr Saul Base 7b merged
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Beta
Zephyr · RichardErkhov
Params7.2B
Context128K
Q4_K_M4.4 GB
ZE
zephyr-7b-dpo-full-prompt-extend-bad
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Beta
Zephyr · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Sft Full SPIN Iter2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b spin iter1 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b spin iter2 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-xlkdlta
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-beta-Nebula-v2-7B
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-dpo-full-judge-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 6b Dpo Full
Zephyr · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB