GGUF models by WesPro

44 GGUF models quantized by WesPro on Hugging Face. Sizes run from 7.24B to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralKuno 7B slerp
Neuralkuno · WesPro
Params7.24B
Context8K
Smallest5.1 GB
GGUF
BR
Broken Tutu 24B
Broken · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Roleplay
MU
MS 24B Mullein v1 test c Q6 K
Mullein · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
BA
ms3 base roselily Q6 K
Base · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
IN
MS2501 24b Ink apollo ep2 Q6 K
Ink · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · WesPro
Params11.8B
Context128K
Smallest9.7 GB
Roleplay
MU
MS 24B Mullein v1 test a Q6 K
Mullein · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
ST
State of the MoE RP 2x7b Q4 K M
State · WesPro
Params12.9B
Context32K
Q4_K_M7.8 GB
Roleplay
FL
MS3 RP Flavours Instruct 24B Q6 K
Flavours · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Roleplay
OP
OpenDolphin 7B slerp
Opendolphin · WesPro
Params7.24B
Context32K
Smallest5.9 GB
GGUF
NE
new ms rp test v0 Q6 K
New · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Roleplay
MU
MS 24B Mullein v1 test b.over Q6 K
Mullein · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
GA
Gaslit Transgression 24B v1.0 Q6 K
Gaslit · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Roleplay
CA
Captain_Crack Sparrow 24B v0.3
Captain · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
TA
MS3 Tantum 24B v0.1 Q6 K
Tantum · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
QW
QwQ 32B
Qwen · WesPro
Params32.8B
Context40K
Smallest26.9 GB
ReasoningTool use
QW
QwQ 32B
Qwen · WesPro
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen2.5 32B ArliAI Ink RPMaxxed v1.0
Qwen · WesPro
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 32B ArliAI EVA RPMaxxed v1.0
Qwen · WesPro
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
MI
Mistral Small 24B Instruct Unalign Q6 K
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
CO
C4AI Aya LoraExpansed 32B Q4 K M
Command R · WesPro
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
MI
notbad v1 0 mistral 24b Q6 K
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
TO
ms 24b toasty heal merge Q6 K
Toasty · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
ME
MS3 megamerge Q6 K
Megamerge · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MI
Mistral Small 24B Instruct 2501 S1
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MI
Mistral Small 24b Harmony Q6 K
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · WesPro
Params23.6B
Context128K
Smallest19.3 GB
GGUF
IN
MS2501 24b Ink apollo ep1 Q6 K
Ink · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
IN
MS Instruct ReasonableRoleplay 24B Q6 K
Instruct · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Roleplay

About WesPro on Hugging Face

WesPro has published 44 GGUF models that ggufmodels.com tracks, across families such as Mistral, Qwen and Mullein. The most downloaded are NeuralKuno 7B slerp, Broken Tutu 24B and MS 24B Mullein v1 test c Q6 K.

The quants WesPro publishes most often are Q6_K (36), Q4_K_M (6) and Q5_K_M (3). Their Q4_K_M files range from 7.8 to 19.9 GB. Parameter counts run from 7.24B to 32.8B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has WesPro published?

44 models are listed here, mainly from the Mistral, Qwen and Mullein families. The most downloaded is NeuralKuno 7B slerp.

Which quants does WesPro publish?

The most common are Q6_K (36 models), Q4_K_M (6 models) and Q5_K_M (3 models).

Keep browsing