Zephyr GGUF models

250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ZE
Zephyr_beta_32k_7B
Zephyr · jeiku
Params7.24B
Context32K
Smallest5.0 GB
GGUF
ZE
Zephyr 7b Beta
Zephyr · habib-z
Params7.24B
Context32K
Smallest14.5 GB
GGUF
ZE
Zephyr Fraudulence Detector
Zephyr · SimplyLeo
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ZE
zephyr-neural-chat-frankenmerge11b
Zephyr · RichardErkhov
Params11.4B
Context32K
Smallest4.2 GB
GGUF
ZE
zephyr 7b beta 4bit
Zephyr · SamTheDev
Params7.24B
Context32K
Smallest4.4 GB
GGUF
ZE
zephyr 7b backup
Zephyr · terrencekuo
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr_mj_7b_v2-gguf
Zephyr · mintaeng
Params7.24B
Context32K
Smallest14.5 GB
GGUF
ZE
Zephyr 7b Beta ReqBrain
Zephyr · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
Zephyr Uxi Fused
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
Zephyr_Ablated_Model_Healed_Layer_1_Gate_Only_Full
Zephyr · JUSTiiNSANE
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing