GGUF models by roleplaiapp

1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingRoleplay
DI
DialoGPT medium anand Q5 K M
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
GGUF
OP
OpenThinker 7B IQ4 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.2 GB
Tool use
MA
MN 12B Mag Mell R1 IQ3 XS
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest5.3 GB
Reasoning
SI
SILMA Kashif 2B Instruct v1.0
Silma · roleplaiapp
Params2.61B
Context12K
Smallest1.6 GB
GGUF
RE
ReaderLM v2 Q5 K S
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.3 GB
CodingRoleplay
TU
TunnedLlama 3.1 8B v2 Q4 K S
Tunnedllama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
GGUF
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.1 GB
CodingRoleplay
OP
OpenThinker 7B IQ3 XS
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.3 GB
Tool use
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest4.7 GB
CodingRoleplay
MA
MN 12B Mag Mell R1 Q3 K M
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest6.1 GB
Reasoning
LL
Llama3.2 doker f16
Llama · roleplaiapp
Params1.24B
Context128K
Smallest2.5 GB
Tool use
OP
OpenThinker 7B Q2 K
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
Llama3 Chinese 8B Instruct
Llama · roleplaiapp
Params8.03B
Context8K
Smallest4.3 GB
GGUF
AP
Apteed LLM Instruct Q2 K
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest2.7 GB
GGUF
RE
ReaderLM v2 Q5 0
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.3 GB
CodingRoleplay
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest1.0 GB
CodingRoleplay
AR
ArxivLlama 3.1 8B Q4 K M
Arxivllama · roleplaiapp
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
Chocolatine 2 14B Instruct v2.0b2 i1 Q4 K S
Chocolatine · roleplaiapp
Params14.8B
Context128K
Smallest8.6 GB
Tool use
MI
MN 12B Mimicore Orochi IQ4 XS
Mimicore · roleplaiapp
Params12.2B
Context1000K
Smallest6.8 GB
GGUF
QW
Omni Reasoner 2B Q3 K M
Qwen · roleplaiapp
Params1.54B
Context32K
Smallest0.8 GB
CodingRoleplayVision
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest22.6 GB
ReasoningTool use
DE
Qwen2.5 32B DeepSeek R1 Instruct i1 Q4 K S
DeepSeek · roleplaiapp
Params32.8B
Context32K
Smallest18.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 3.1 16.5B Brainstorm i1 Q4 K S
DeepSeek · roleplaiapp
Params16.5B
Context128K
Smallest9.5 GB
ReasoningTool use
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest3.8 GB
CodingRoleplay
QW
14B Qwen2.5 Kunou v1 Q2 K
Qwen · roleplaiapp
Params14.8B
Context128K
Smallest5.8 GB
Tool use
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest3.0 GB
CodingRoleplay
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
JA
Jaja small v1 Q6 K
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.4 GB
GGUF
AR
ArxivLlama 3.1 8B Q4 K S
Arxivllama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
GGUF

Keep browsing