GGUF models by roleplaiapp

1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Small 24B Instruct 2501
Mistral · roleplaiapp
Params23.6B
Context32K
Smallest12.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.9 GB
ReasoningTool use
PL
Plato 9b
Plato · roleplaiapp
Params9.24B
Context8K
Smallest5.5 GB
GGUF
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Q4_K_M7.5 GB
CodingRoleplay
DI
DialoGPT medium anand Q6 K
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
GGUF
AP
Apteed LLM Instruct Q6 K
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest5.9 GB
GGUF
DI
DialoGPT medium anand Q5 K S
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest37.1 GB
CodingRoleplayTool use
QW
Dria Agent A 3B
Qwen · roleplaiapp
Params10M
Context32K
Q4_K_M0.0 GB
CodingRoleplayTool use
VI
Virtuoso Lite
Virtuoso · roleplaiapp
Params10.3B
Context32K
Smallest7.3 GB
Tool use
RE
ReaderLM v2 Q4 0
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.1 GB
CodingRoleplay
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest1.9 GB
CodingReasoningRoleplay
MA
MN 12B Mag Mell R1 Q5 K S
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest8.5 GB
Reasoning
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Smallest6.1 GB
CodingRoleplay
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest34.8 GB
CodingReasoningRoleplay
SI
SILMA Kashif 2B Instruct v1.0
Silma · roleplaiapp
Params2.61B
Context12K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.6 GB
Tool use
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 IQ4 XS
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest38.3 GB
ReasoningTool use
OP
OpenThinker 7B f16
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
Tool use
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest49.9 GB
CodingRoleplayTool use
AP
Apteed LLM Instruct Q3 K M
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest3.5 GB
GGUF
JA
Jaja small v1 IQ4 XS
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.2 GB
GGUF
LL
Llama3 Chinese 8B Instruct
Llama · roleplaiapp
Params8.03B
Context8K
Smallest5.6 GB
GGUF
AC
AceInstruct 72B
Aceinstruct · roleplaiapp
Params72.7B
Context128K
Smallest41.2 GB
CodingRoleplay
MI
Codestral 22B v0.1
Mistral · roleplaiapp
Params22.2B
Context32K
Smallest18.3 GB
CodingRoleplay
LL
Selene 1 Mini Llama 3.1 8B Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
Tool use
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest2.0 GB
CodingReasoningRoleplay
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest5.1 GB
CodingRoleplay
PA
Pathfinder RP 12B RU Q5 K S
Pathfinder · roleplaiapp
Params12.2B
Context1000K
Smallest8.5 GB
Roleplay
PH
Phi 4 ReasoningRP Q8 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest15.6 GB
Reasoning

Keep browsing