GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
QW
Dria Agent A 7B
Qwen · roleplaiapp
Params9M
Context32K
Smallest0.0 GB
QW
14B Qwen2.5 Kunou v1 Q3 K S
Qwen · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
PH
phi 4 Q3 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest6.5 GB
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Smallest5.5 GB
AL
ALIA 40b
Alia · roleplaiapp
Params40.4B
Context4K
Smallest15.7 GB
QW
Dria Agent A 7B
Qwen · roleplaiapp
Params16M
Context32K
Smallest0.0 GB
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Smallest8.7 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest12.3 GB
VI
Virtuoso Lite
Virtuoso · roleplaiapp
Params10.3B
Context32K
Smallest5.5 GB
QW
Qwen2.5-1.5B-Open-R1-Distill
Qwen · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
JA
JapMed SLERP IQ4 XS
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest4.5 GB
DI
DS R1 Distill Q2.5 14B Harmony V0.1 Q5 K S
Distill · roleplaiapp
Params14.8B
Context128K
Smallest10.3 GB
OP
OpenThinker 7B Q5 K S
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
QW
Dria Agent A 3B
Qwen · roleplaiapp
Params9M
Context32K
Smallest0.0 GB
SA
saiga nemo 12b gguf Q3 K S
Saiga · roleplaiapp
Params12.2B
Context1000K
Smallest5.5 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q4 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest40.0 GB
MI
Mistral Small 24B Instruct 2501
Mistral · roleplaiapp
Params23.6B
Context32K
Smallest10.4 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q3 K L
Llama · roleplaiapp
Params70.6B
Context128K
Smallest37.1 GB
JA
Janus Pro 7B LM
Janus · roleplaiapp
Params6.91B
Context16K
Smallest3.1 GB
CY
Cydonia 24B v2a Q6 K
Cydonia · roleplaiapp
Params23.6B
Context32K
Smallest19.3 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
AC
AceInstruct 72B
Aceinstruct · roleplaiapp
Params72.7B
Context128K
Smallest77.3 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest1.6 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q3 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest34.3 GB
DI
DS R1 Distill Q2.5 14B Harmony V0.1 Q8 0
Distill · roleplaiapp
Params14.8B
Context128K
Smallest15.7 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.7 GB
MA
MN 12B Mag Mell R1 IQ4 XS
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest6.8 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest10.3 GB