Zephyr GGUF models
250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-dpo-full-shuffle-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-dpo-full-judge-after
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b spin iter3 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b truthy i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-feedforward-full
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-alpha-Nebula-v2-7B
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr speakleash 010 pl 3072 32 16 0.01 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-wizard-kuno-royale-BF16-merge-7B
Zephyr · grimjim
Params7.24B
Context32K
Smallest4.4 GB
ZE
Zephyr beta 32k 7B i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr dpo v2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ZE
zephyr-7b-beta-KOR-OpenOrca-Platypus-1e-5
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr beta wizardLM 2 merge 7B i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7b Beta
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ZE
BarraHome/zephyr-dpo-v2
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr Quiklang 3b
Zephyr · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
ZE
zephyr 7b r2d2 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr Orpo 7b v0.2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
heegyu/zephyr-7b-beta-KOR-OpenOrca-Platypus-1e-5
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-220m-sft-full
Zephyr · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
ZE
zephyr-7b-dpo-full-shuffle-chosen-after
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b r2d2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr-7b-alpha-sharded
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
UCLA AGI Zephyr 7b Sft Full SPIN Iter2
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ZE
vicgalle/zephyr-7b-truthy
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr Sft
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b truthy
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr 7B Norobots
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB