GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
PH
Phi 4 ReasoningRP Q3 K M
Phi · roleplaiapp
Params14.7B
Context16K
Smallest7.2 GB
LL
Llama3.2 doker Q8 0
Llama · roleplaiapp
Params1.24B
Context128K
Smallest1.3 GB
DI
DialoGPT medium anand Q3 K L
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.2 GB
LL
Reasoning Llama 3.1 CoT RE1 Q4 K M
Llama · roleplaiapp
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
TunnedLlama 3.1 8B v2 Q5 K S
Tunnedllama · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
SL
Slush Sunfall Rocinante GGLD 12B Q6 K
Slush · roleplaiapp
Params12.2B
Context1000K
Smallest10.1 GB
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
AR
ArxivLlama 3.1 8B Q3 K M
Arxivllama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
DE
DeepSeek R1 Distill Alpaca FineTuned Q5 K M
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest12.3 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest26.9 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · roleplaiapp
Params7.62B
Context986K
Smallest6.3 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · roleplaiapp
Params7.62B
Context986K
Smallest4.2 GB
LL
Llama 3 monika ddlc 11.5b v1 i1 Q4 K M
Llama · roleplaiapp
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
Llama 3 monika ddlc 11.5b v1 i1 IQ3 XS
Llama · roleplaiapp
Params11.5B
Context8K
Smallest4.9 GB
ME
medicine LLM Q6 K
Medicine · roleplaiapp
Params6.74B
Context2K
Smallest5.5 GB
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Smallest10.5 GB
DE
DeepSeek R1 Distill sthenno 14b 0121 Q4 K M
DeepSeek · roleplaiapp
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill sthenno 14b 0121 Q5 K S
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest10.3 GB
DA
L3 DARKEST PLANET 16.5B Q8 0
Darkest · roleplaiapp
Params16.5B
Context8K
Smallest17.6 GB
PL
Plato 9b
Plato · roleplaiapp
Params9.24B
Context8K
Smallest4.8 GB
SJ
SJT Moe2x7.5B Q2 K
Sjt · roleplaiapp
Params13.4B
Context32K
Smallest5.0 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest22.6 GB
DE
Qwen2.5 14B DeepSeek R1 1M Q6 K
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest12.1 GB
LL
Selene 1 Mini Llama 3.1 8B Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
SJ
SJT Moe2x7.5B IQ4 XS
Sjt · roleplaiapp
Params13.4B
Context32K
Smallest7.3 GB
LL
DS Distilled Hermes Llama 3.1 TIES i1 Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · roleplaiapp
Params22.2B
Context128K
Smallest9.2 GB
DE
q 2.5 deepseek r1 veltha v0.3 Q3 K S
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.7 GB
JA
Jaja small v1 Q3 K L
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.2 GB