GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Q4_K_M4.7 GB
DI
DialoGPT medium anand Q5 K M
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
OP
OpenThinker 7B IQ4 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.2 GB
MA
MN 12B Mag Mell R1 IQ3 XS
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest5.3 GB
SI
SILMA Kashif 2B Instruct v1.0
Silma · roleplaiapp
Params2.61B
Context12K
Smallest1.6 GB
RE
ReaderLM v2 Q5 K S
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.3 GB
TU
TunnedLlama 3.1 8B v2 Q4 K S
Tunnedllama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.1 GB
OP
OpenThinker 7B IQ3 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.3 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.7 GB
MA
MN 12B Mag Mell R1 Q3 K M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest6.1 GB
LL
Llama3.2 doker f16
Llama · roleplaiapp
Params1.24B
Context128K
Smallest2.5 GB
OP
OpenThinker 7B Q2 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.0 GB
LL
Llama3 Chinese 8B Instruct
Llama · roleplaiapp
Params8.03B
Context8K
Smallest4.3 GB
AP
Apteed LLM Instruct Q2 K
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest2.7 GB
RE
ReaderLM v2 Q5 0
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.3 GB
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.0 GB
AR
ArxivLlama 3.1 8B Q4 K M
Arxivllama · roleplaiapp
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chocolatine 2 14B Instruct v2.0b2 i1 Q4 K S
Chocolatine · roleplaiapp
Params14.8B
Context128K
Smallest8.6 GB
MI
MN 12B Mimicore Orochi IQ4 XS
Mimicore · roleplaiapp
Params12.2B
Context1000K
Smallest6.8 GB
QW
Omni Reasoner 2B Q3 K M
Qwen · roleplaiapp
Params1.54B
Context32K
Smallest0.8 GB
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest22.6 GB
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 Q4 K S
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest18.8 GB
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q4 K S
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest9.5 GB
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest3.8 GB
QW
14B Qwen2.5 Kunou v1 Q2 K
Qwen · roleplaiapp
Params14.8B
Context128K
Smallest5.8 GB
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest3.0 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
JA
Jaja small v1 Q6 K
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.4 GB
AR
ArxivLlama 3.1 8B Q4 K S
Arxivllama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB