GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
PH
phi 4 Q6 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest12.0 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Q4_K_M5.4 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest57.9 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored IQ4 XS
Qwen · roleplaiapp
Params14.8B
Context32K
Smallest8.2 GB
RU
RuadaptQwen2.5 32B Pro
Ruadaptqwen · roleplaiapp
Params32.7B
Context32K
Smallest26.8 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · roleplaiapp
Params7.62B
Context128K
Smallest3.5 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.6 GB
QW
Omni Reasoner 2B Q8 0
Qwen · roleplaiapp
Params1.54B
Context32K
Smallest1.6 GB
DC
oh dcft v3.1 claude 3 5 haiku 20241022 Q3 K L
Dcft · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest1.4 GB
LL
Llama 3.2 3B Instruct
Llama · roleplaiapp
Params3.61B
Context128K
Smallest1.5 GB
RU
RuadaptQwen2.5 32B Pro
Ruadaptqwen · roleplaiapp
Params32.7B
Context32K
Smallest23.2 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest3.7 GB
NE
L3.3 Nevoria R1 70b Q2 K
Nevoria · roleplaiapp
Params70.6B
Context128K
Smallest26.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
QW
FuseO1 DeekSeekR1 QwQ SkyT1 32B Preview
Qwen · roleplaiapp
Params32B
Context128K
Smallest39.8 GB
QW
Qwen2.5 32b Erudite Writer i1 Q5 K S
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest22.6 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest49.9 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest17.2 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest4.3 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest6.6 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest6.6 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored Q2 K
Qwen · roleplaiapp
Params14.8B
Context32K
Smallest5.8 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored Q5 K S
Qwen · roleplaiapp
Params14.8B
Context32K
Smallest10.3 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest2.4 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest17.2 GB
JA
Janus Pro 7B LM
Janus · roleplaiapp
Params6.91B
Context16K
Q4_K_M4.2 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest1.4 GB