Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-judge-after
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter3 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b truthy i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-feedforward-full
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-alpha-Nebula-v2-7B
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr speakleash 010 pl 3072 32 16 0.01 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-wizard-kuno-royale-BF16-merge-7B
Zephyr · grimjim
Params7.24B
Context32K
Smallest4.4 GB
GGUF
ZE
Zephyr beta 32k 7B i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr dpo v2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
zephyr-7b-beta-KOR-OpenOrca-Platypus-1e-5
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr beta wizardLM 2 merge 7B i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
BarraHome/zephyr-dpo-v2
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Quiklang 3b
Zephyr · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
ZE
zephyr 7b r2d2 i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Orpo 7b v0.2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
heegyu/zephyr-7b-beta-KOR-OpenOrca-Platypus-1e-5
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-220m-sft-full
Zephyr · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-chosen-after
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b r2d2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-alpha-sharded
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
UCLA AGI Zephyr 7b Sft Full SPIN Iter2
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
vicgalle/zephyr-7b-truthy
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Sft
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b truthy
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B Norobots
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding

Keep browsing