GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
RU
RuadaptQwen2.5 32B Pro
Ruadaptqwen · roleplaiapp
Params32.7B
Context32K
Q4_K_M19.8 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
DI
DialoGPT medium anand Q3 K S
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.2 GB
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · roleplaiapp
Params22.2B
Context128K
Smallest15.7 GB
QW
Qwen2.5 32B Instruct
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest15.9 GB
LL
DeepSauerHuatuoSkywork R1 O1 Llama 3.1 8B
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
QW
Dria Agent A 3B
Qwen · roleplaiapp
Params6M
Context32K
Smallest0.0 GB
CR
Crumb 13B Q4 K M
Crumb · roleplaiapp
Params13B
Context4K
Q4_K_M7.9 GB
PA
Pathfinder RP 12B RU Q2 K
Pathfinder · roleplaiapp
Params12.2B
Context1000K
Smallest4.8 GB
DI
DialoGPT medium anand f16
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.8 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
JA
Jaja small v1 Q3 K M
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.2 GB
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest6.1 GB
JA
Jaja small v1 Q3 K S
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.2 GB
PH
phi 4 Q5 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
CO
Confucius O1 14B
Confucius · roleplaiapp
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 0
Llama · roleplaiapp
Params70.6B
Context128K
Smallest48.7 GB
SI
SILMA Kashif 2B Instruct v1.0
Silma · roleplaiapp
Params2.61B
Context12K
Smallest2.2 GB
DE
q 2.5 deepseek r1 veltha v0.3 Q4 K S
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest8.6 GB
AR
ArxivLlama 3.1 8B Q3 K L
Arxivllama · roleplaiapp
Params8.03B
Context128K
Smallest4.3 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest9.4 GB
OP
OpenThinker 7B Q3 K L
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest4.1 GB
MI
Mistral Small 24B Instruct 2501
Mistral · roleplaiapp
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
DS Distilled Hermes Llama 3.1 TIES i1 IQ3 M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest3.8 GB
MI
Mistral Small 24B Instruct 2501
Mistral · roleplaiapp
Params23.6B
Context32K
Smallest10.7 GB
AC
AceInstruct 72B
Aceinstruct · roleplaiapp
Params72.7B
Context128K
Smallest50.2 GB
CY
Cydonia 24B v2a Q2 K
Cydonia · roleplaiapp
Params23.6B
Context32K
Smallest8.9 GB
LL
Llama3 Chinese 8B Instruct
Llama · roleplaiapp
Params8.03B
Context8K
Smallest3.2 GB