GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
MI
Mistral Small 24B Instruct 2501
Mistral · roleplaiapp
Params23.6B
Context32K
Smallest12.8 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.9 GB
PL
Plato 9b
Plato · roleplaiapp
Params9.24B
Context8K
Smallest5.5 GB
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Q4_K_M7.5 GB
DI
DialoGPT medium anand Q6 K
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
AP
Apteed LLM Instruct Q6 K
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest5.9 GB
DI
DialoGPT medium anand Q5 K S
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.3 GB
LL
Llama 3.3 70B Instruct
Llama · roleplaiapp
Params70.6B
Context128K
Smallest37.1 GB
QW
Dria Agent A 3B
Qwen · roleplaiapp
Params10M
Context32K
Q4_K_M0.0 GB
VI
Virtuoso Lite
Virtuoso · roleplaiapp
Params10.3B
Context32K
Smallest7.3 GB
RE
ReaderLM v2 Q4 0
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.1 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest1.9 GB
MA
MN 12B Mag Mell R1 Q5 K S
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest8.5 GB
MI
Wayfarer 12b
Mistral · roleplaiapp
Params12.2B
Context128K
Smallest6.1 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest34.8 GB
SI
SILMA Kashif 2B Instruct v1.0
Silma · roleplaiapp
Params2.61B
Context12K
Q4_K_M1.7 GB
QW
Qwen2.5 7B Olm v1.4
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.6 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 IQ4 XS
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest38.3 GB
OP
OpenThinker 7B f16
Openthinker · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q5 K M
Llama · roleplaiapp
Params70.6B
Context128K
Smallest49.9 GB
AP
Apteed LLM Instruct Q3 K M
Apteed · roleplaiapp
Params7.24B
Context8K
Smallest3.5 GB
JA
Jaja small v1 IQ4 XS
Jaja · roleplaiapp
Params362M
Context8K
Smallest0.2 GB
LL
Llama3 Chinese 8B Instruct
Llama · roleplaiapp
Params8.03B
Context8K
Smallest5.6 GB
AC
AceInstruct 72B
Aceinstruct · roleplaiapp
Params72.7B
Context128K
Smallest41.2 GB
MI
Codestral 22B v0.1
Mistral · roleplaiapp
Params22.2B
Context32K
Smallest18.3 GB
LL
Selene 1 Mini Llama 3.1 8B Q5 K M
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.7 GB
QW
SmallThinker 3B Preview
Qwen · roleplaiapp
Params3.4B
Context32K
Smallest2.0 GB
IN
Internlm3 8b Instruct
InternLM · roleplaiapp
Params8.8B
Context32K
Smallest5.1 GB
PA
Pathfinder RP 12B RU Q5 K S
Pathfinder · roleplaiapp
Params12.2B
Context1000K
Smallest8.5 GB
PH
Phi 4 ReasoningRP Q8 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest15.6 GB