GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
LL
Llama 3 monika ddlc 11.5b v1 i1 Q5 K S
Llama · roleplaiapp
Params11.5B
Context8K
Smallest8.0 GB
LL
Llama 3 monika ddlc 11.5b v1 i1 IQ3 M
Llama · roleplaiapp
Params11.5B
Context8K
Smallest5.3 GB
QW
Qwen2.5 32B Instruct
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest26.9 GB
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · roleplaiapp
Params22.2B
Context128K
Smallest15.3 GB
QW
Qwen2.5-1.5B-Open-R1-Distill
Qwen · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
JA
JapMed SLERP Q6 K
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest6.6 GB
JA
JapMed SLERP Q3 K L
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest4.3 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · roleplaiapp
Params7.62B
Context986K
Q4_K_M4.7 GB
ME
medicine LLM Q5 K M
Medicine · roleplaiapp
Params6.74B
Context2K
Smallest4.8 GB
PH
Phi 4 ReasoningRP Q3 K L
Phi · roleplaiapp
Params14.7B
Context16K
Smallest7.8 GB
LL
Llama3.2 doker Q5 K S
Llama · roleplaiapp
Params1.24B
Context128K
Smallest0.9 GB
DE
Qwen2.5 14B DeepSeek R1 1M i1 IQ4 XS
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest8.1 GB
DE
Qwen2.5 14B DeepSeek R1 1M Q4 K M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Q4_K_M9.0 GB
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Smallest8.1 GB
LL
Lascivious LLaMa 70B Q4 K S
Llama · roleplaiapp
Params70.6B
Context128K
Smallest40.3 GB
VI
Virtuoso Lite
Virtuoso · roleplaiapp
Params10.3B
Context32K
Smallest6.0 GB
MI
Minerva 14b
Minerva · roleplaiapp
Params14.8B
Context32K
Smallest10.5 GB
LL
Llama3.2 doker Q5 K M
Llama · roleplaiapp
Params1.24B
Context128K
Smallest0.9 GB
SL
Slush Sunfall Rocinante GGLD 12B Q5 K S
Slush · roleplaiapp
Params12.2B
Context1000K
Smallest8.5 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · roleplaiapp
Params7.62B
Context986K
Smallest8.1 GB
DE
DeepSky T100 Q3 K L
Deepsky · roleplaiapp
Params32.8B
Context128K
Smallest17.2 GB
YU
YuE s1 7B anneal en cot Q4 K S
Yue · roleplaiapp
Params6.22B
Context16K
Smallest3.6 GB
ME
medicine LLM Q3 K S
Medicine · roleplaiapp
Params6.74B
Context2K
Smallest2.9 GB
FA
FastHunyuan gguf Q5 K S
Fasthunyuan · roleplaiapp
Params12.8B
Context—
Smallest9.3 GB
CR
Crumb 13B Q4 K S
Crumb · roleplaiapp
Params13B
Context4K
Smallest7.4 GB
PL
Plato 9b
Plato · roleplaiapp
Params9.24B
Context8K
Smallest7.6 GB
QW
14B Qwen2.5 Kunou v1 Q3 K L
Qwen · roleplaiapp
Params14.8B
Context128K
Smallest7.9 GB
CH
Chocolatine 2 14B Instruct v2.0b2 i1 Q3 K M
Chocolatine · roleplaiapp
Params14.8B
Context128K
Smallest7.3 GB
DE
q 2.5 deepseek r1 veltha v0.3 Q6 K
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest12.1 GB
LL
Reasoning Llama 3.1 CoT RE1 i1 Q3 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB