Wizardlm GGUF models

127 GGUF models in the Wizardlm family, quantized by 56 uploaders. Sizes run from 1.24B to 141B parameters. The longest trained context is 64K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
WI
WizardLM 13B V1.0
Wizardlm · Stark2008
Params13B
Context2K
Smallest6.9 GB
GGUF
WI
WizardLM-2-7B
Wizardlm · JayrDev
Params7.24B
Context32K
Smallest4.1 GB
GGUF
WI
gguf sharded smashed WizardLM 2 7B
Wizardlm · Felladrin
Params7.24B
Context32K
Smallest2.7 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · actionpace
Params13B
Context4K
Smallest9.8 GB
GGUF
WI
WizardLM 13B V1.0
Wizardlm · actionpace
Params13B
Context2K
Smallest9.8 GB
GGUF
WI
WizardLM-2-7B
Wizardlm · JayrDev
Params7.24B
Context32K
Smallest4.1 GB
GGUF
WI
WizardLM 2 8x22B
Wizardlm · lasrevinu333-design
Params141B
Context64K
Q4_K_M85.6 GB
GGUF

Keep browsing