Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
zephyr 7b dpo maximal
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr python ru merged
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-delete_0.1
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
notus 7b v1
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-delete_0.5
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b spin iter0 v0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-gpo-final-i0
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-orpo-141b-A35b-v0.1
Zephyr · qwp4w3hyb
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
ZE
Zephyr 7b Beta Absolute Heresy
Zephyr · mradermacher
Params7.24B
Context64K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b UC 0 B0.5
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b dpo full
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-delete_0.9
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-beta-pl
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr quiklang 3b
Zephyr · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
Tool use
ZE
zephyr simpo data zephyr
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
grimjim/zephyr-beta-wizardLM-2-merge-7B
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
BioMistral 7B Zephyr Beta SLERP
Zephyr · BioMistral
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-bad-after
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr Sft Bnb 4bit
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-norandom
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B DICE Iter2
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-shuffle-only-rejected-before
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr-7b-dpo-full-prompt-extend-chosen-noshort
Zephyr · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr 7B Beta Helpful
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing