Wizardlm GGUF models
127 GGUF models in the Wizardlm family, quantized by 56 uploaders. Sizes run from 1.24B to 141B parameters. The longest trained context is 64K tokens.
WI
WizardLM 13B V1.0
Wizardlm · Stark2008
Params13B
Context2K
Smallest6.9 GB
WI
WizardLM-2-7B
Wizardlm · JayrDev
Params7.24B
Context32K
Smallest4.1 GB
WI
gguf sharded smashed WizardLM 2 7B
Wizardlm · Felladrin
Params7.24B
Context32K
Smallest2.7 GB
WI
WizardLM 13B V1.2
Wizardlm · actionpace
Params13B
Context4K
Smallest9.8 GB
WI
WizardLM 13B V1.0
Wizardlm · actionpace
Params13B
Context2K
Smallest9.8 GB
WI
WizardLM-2-7B
Wizardlm · JayrDev
Params7.24B
Context32K
Smallest4.1 GB
WI
WizardLM 2 8x22B
Wizardlm · lasrevinu333-design
Params141B
Context64K
Q4_K_M85.6 GB