GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
LL
Reasoning Llama 3.1 CoT RE1 i1 IQ3 M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.8 GB
DI
DS R1 Distill Q2.5 14B Harmony V0.1 Q2 K
Distill · roleplaiapp
Params14.8B
Context128K
Smallest5.8 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest7.9 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest75.0 GB
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 IQ3 M
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest14.8 GB
RE
ReaderLM v2 Q4 K M
Readerlm · roleplaiapp
Params1.78B
Context501K
Q4_K_M1.1 GB
RU
RuadaptQwen2.5 32B Pro
Ruadaptqwen · roleplaiapp
Params32.7B
Context32K
Smallest12.3 GB
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32B
Context128K
Smallest39.9 GB
JA
JapMed SLERP Q4 K S
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest4.7 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest3.6 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B gguf Q8 0
Mistral · roleplaiapp
Params24.2B
Context32K
Smallest25.7 GB
QW
Dria Agent A 7B
Qwen · roleplaiapp
Params9M
Context32K
Smallest0.0 GB
AC
AceInstruct 72B Q3 K S
Aceinstruct · roleplaiapp
Params72B
Context—
Smallest27.1 GB
MA
MN 12B Mag Mell R1 IQ3 M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest5.7 GB
MA
MN 12B Mag Mell R1 Q5 K M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest8.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.3 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest22.6 GB
AC
AceInstruct 72B Q2 K
Aceinstruct · roleplaiapp
Params72B
Context—
Smallest27.1 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest18.8 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.6 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Q3 K S
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest12.3 GB
QW
FuseO1 DeekSeekR1 QwQ SkyT1 32B Preview
Qwen · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest6.3 GB