Zephyr GGUF models
250 GGUF models in the Zephyr family, quantized by 70 uploaders. Sizes run from 7M to 141B parameters. The longest trained context is 195K tokens.
ZE
Zephyr_beta_32k_7B
Zephyr · jeiku
Params7.24B
Context32K
Smallest5.0 GB
ZE
Zephyr 7b Beta
Zephyr · habib-z
Params7.24B
Context32K
Smallest14.5 GB
ZE
Zephyr Fraudulence Detector
Zephyr · SimplyLeo
Params7.24B
Context32K
Smallest7.7 GB
ZE
zephyr-neural-chat-frankenmerge11b
Zephyr · RichardErkhov
Params11.4B
Context32K
Smallest4.2 GB
ZE
zephyr 7b beta 4bit
Zephyr · SamTheDev
Params7.24B
Context32K
Smallest4.4 GB
ZE
zephyr 7b backup
Zephyr · terrencekuo
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr_mj_7b_v2-gguf
Zephyr · mintaeng
Params7.24B
Context32K
Smallest14.5 GB
ZE
Zephyr 7b Beta ReqBrain
Zephyr · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
ZE
Zephyr Uxi Fused
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
Zephyr_Ablated_Model_Healed_Layer_1_Gate_Only_Full
Zephyr · JUSTiiNSANE
Params7.24B
Context32K
Q4_K_M4.4 GB