GGUF models by roleplaiapp

1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingRoleplay
QW
Omni Reasoner 2B Q6 K
Qwen · roleplaiapp
Params1.54B
Context32K
Smallest1.3 GB
CodingRoleplayVision
DI
DialoGPT medium anand Q4 K M
Dialogpt · roleplaiapp
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q6 K
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest13.6 GB
ReasoningTool use
QW
FuseO1 DeekSeekR1 QwQ SkyT1 32B Preview
Qwen · roleplaiapp
Params32.8B
Context128K
Smallest14.8 GB
ReasoningTool use
LL
Reasoning Llama 3.1 CoT RE1 i1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
ReasoningTool use
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
Reasoning
QW
Qwen2.5 32B Instruct
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest14.4 GB
ReasoningTool use
SL
Slush Sunfall Rocinante GGLD 12B Q2 K
Slush · roleplaiapp
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Smallest12.1 GB
Tool use
DE
DeepSeek R1 Distill sthenno 14b 0121 Q8 0
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest15.7 GB
Reasoning
QW
Qwen2.5 32B Instruct
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest17.2 GB
ReasoningTool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest23.3 GB
ReasoningTool use
AP
Apteed LLM Instruct Q4 K S
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest4.1 GB
GGUF
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Smallest8.6 GB
Tool use
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest22.6 GB
CodingReasoningRoleplay
FA
FastHunyuan gguf Q4 K S
Fasthunyuan · roleplaiapp
Params12.8B
Context—
Smallest7.7 GB
GGUF
DI
DS R1 Distill Q2.5 14B Harmony V0.1 Q6 K
Distill · roleplaiapp
Params14.8B
Context128K
Smallest12.1 GB
ReasoningTool use
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest4.1 GB
Tool use
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · roleplaiapp
Params22.2B
Context128K
Smallest18.3 GB
RoleplayTool use
OP
OpenThinker 7B Q3 K M
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
Tool use
FA
FastHunyuan gguf Q3 K S
Fasthunyuan · roleplaiapp
Params12.8B
Context—
Smallest6.1 GB
GGUF
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Smallest6.7 GB
Tool use
CR
Crumb 13B Q3 K M
Crumb · roleplaiapp
Params13B
Context4K
Smallest6.3 GB
GGUF
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.3 GB
CodingRoleplay
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Smallest4.8 GB
CodingRoleplay
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest22.6 GB
CodingReasoningRoleplay
PH
Phi 4 ReasoningRP Q2 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest5.6 GB
Reasoning
DE
DeepSeek R1 Distill sthenno 14b 0121 Q3 K M
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest7.3 GB
Reasoning
QW
Qwen2.5 32B Instruct
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest14.4 GB
ReasoningTool use

Keep browsing