GGUF models by roleplaiapp
1023 GGUF models quantized by roleplaiapp on Hugging Face. Sizes run from 6M to 72.7B parameters. The longest trained context is 1000K tokens.
AL
ALIA 40b
Alia · roleplaiapp
Params40.4B
Context4K
Smallest23.3 GB
AC
AceInstruct 72B
Aceinstruct · roleplaiapp
Params72.7B
Context128K
Smallest54.4 GB
VI
Virtuoso Lite
Virtuoso · roleplaiapp
Params10.3B
Context32K
Smallest5.1 GB
DE
Qwen2.5 32B
DeepSeek · roleplaiapp
Params32.8B
Context128K
Smallest34.8 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · roleplaiapp
Params70.6B
Context128K
Smallest30.9 GB
QW
QwQ 32B Preview
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest15.9 GB
QW
Dria Agent A 3B
Qwen · roleplaiapp
Params16M
Context32K
Smallest0.0 GB
DI
DialoGPT medium anand Q4 K S
Dialogpt · roleplaiapp
Params406M
Context1K
Smallest0.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.5 GB
RE
ReaderLM v2 Q3 K L
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.0 GB
JA
JapMed SLERP Q5 K M
Japmed · roleplaiapp
Params8.03B
Context8K
Smallest5.7 GB
LL
DS Distilled Hermes Llama 3.1 TIES i1 Q5 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest3.2 GB
DE
Qwen2.5 14B DeepSeek R1 1M
DeepSeek · roleplaiapp
Params14.8B
Context986K
Smallest7.3 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest5.6 GB
RE
ReaderLM v2 Q8 0
Readerlm · roleplaiapp
Params1.78B
Context501K
Smallest1.9 GB
AC
AceInstruct 7B
Aceinstruct · roleplaiapp
Params7.62B
Context128K
Smallest4.5 GB
LL
Reasoning Llama 3.1 CoT RE1 Q4 K S
Llama · roleplaiapp
Params8.03B
Context128K
Smallest4.7 GB
DE
DeepSeek R1 Distill Alpaca FineTuned Q3 K M
DeepSeek · roleplaiapp
Params8.03B
Context128K
Smallest4.0 GB
PH
phi 4 Q5 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
MA
MN 12B Mag Mell R1 Q8 0
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest13.0 GB
MI
Midnight Miqu 70b v1.5
Midnight · roleplaiapp
Params69B
Context32K
Smallest39.2 GB
JA
JapMed SLERP Q4 K M
Japmed · roleplaiapp
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 32b Erudite Writer i1 Q3 K S
Qwen · roleplaiapp
Params32.8B
Context32K
Smallest14.4 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · roleplaiapp
Params14.8B
Context128K
Smallest6.4 GB
MA
MN 12B Mag Mell R1 Q4 K S
Mag · roleplaiapp
Params12.2B
Context1000K
Smallest7.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · roleplaiapp
Params1.78B
Context128K
Smallest1.9 GB
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest0.8 GB
LL
Llama 3.1 Nemotron 70B Instruct HF Q6 K
Llama · roleplaiapp
Params70.6B
Context128K
Smallest57.9 GB
AC
AceInstruct 1.5B
Aceinstruct · roleplaiapp
Params1.78B
Context128K
Smallest0.9 GB