GGUF models by WesPro

44 GGUF models quantized by WesPro on Hugging Face. Sizes run from 7.24B to 32.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
FR
G3 27b Frankenglitter
Frankenglitter · WesPro
Params27B
Context128K
Smallest19.3 GB
GGUF
DA
DarkHazard v1.1 24b
Darkhazard · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
CR
CreativeStarCommand08 32B Q4 K M
Creativestarcommand · WesPro
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
WI
Wizard Kun Lake 3x7B MoE Q5 K M
Wizard · WesPro
Params18.5B
Context32K
Smallest13.1 GB
GGUF
MI
Mistral Small R1 Tensopolis
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Reasoning
AP
Apollo 24B Q6 K
Apollo · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
DA
24b ms dans personality engine v1.2.0 RC Q6 K
Dans · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
IN
MS2501 24b Ink apollo ep0.5 Q6 K
Ink · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
NA
Napoleon 24B V0.0 Q6 K
Napoleon · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
MU
MS 24B Mullein v1 test aa Q6 K
Mullein · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
CL
Clara 24B
Clara · WesPro
Params23.6B
Context128K
Smallest19.3 GB
GGUF
MI
Mistral R1 Preview Q6 K
Mistral · WesPro
Params23.6B
Context32K
Smallest19.3 GB
Reasoning
SA
Saka 24B Q6 K
Saka · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
LL
MS 24B Mullein v1 test aa ep2 Q6 K
Llama · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF

Keep browsing