GGUF models by roleplaiapp

1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
CodingReasoningRoleplay
LL
Reasoning Llama 3.1 CoT RE1 i1 IQ3 M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.8 GB
ReasoningTool use
DI
DS R1 Distill Q2.5 14B Harmony V0.1 Q2 K
Distill · roleplaiapp
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
CodingRoleplayTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest7.9 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
CodingRoleplayTool use
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest75.0 GB
CodingReasoningRoleplay
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 IQ3 M
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest14.8 GB
ReasoningTool use
RE
ReaderLM v2 Q4 K M
Readerlm · roleplaiapp
Params1.78B
Context501K
Q4_K_M1.1 GB
CodingRoleplay
RU
RuadaptQwen2.5 32B Pro
Ruadaptqwen · roleplaiapp
Params32.7B
Context32K
Smallest12.3 GB
Tool use
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32B
Context128K
Smallest39.9 GB
Reasoning
JA
JapMed SLERP Q4 K S
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest4.7 GB
GGUF
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest3.6 GB
CodingReasoningRoleplay
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B gguf Q8 0
Mistral · roleplaiapp
Params24.2B
Context32K
Smallest25.7 GB
GGUF
QW
Dria Agent A 7B
Qwen · roleplaiapp
Params9M
Context32K
Smallest0.0 GB
CodingRoleplayTool use
AC
AceInstruct 72B Q3 K S
Aceinstruct · roleplaiapp
Params72B
Context—
Smallest27.1 GB
CodingRoleplay
MA
MN 12B Mag Mell R1 IQ3 M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest5.7 GB
Reasoning
MA
MN 12B Mag Mell R1 Q5 K M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest8.7 GB
Reasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
CodingReasoningRoleplay
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.3 GB
CodingRoleplay
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest22.6 GB
CodingReasoningRoleplay
AC
AceInstruct 72B Q2 K
Aceinstruct · roleplaiapp
Params72B
Context—
Smallest27.1 GB
CodingRoleplay
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.8 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoningRoleplay
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Q3 K S
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
ReasoningTool use
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest12.3 GB
CodingReasoningRoleplay
QW
FuseO1 DeekSeekR1 QwQ SkyT1 32B Preview
Qwen · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest6.3 GB
CodingRoleplay

Keep browsing