GGUF models by mmnga
261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.
QW
ABEJA Qwen2.5 7b Japanese v0.1
Qwen · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SakanaAI EvoLLM JP A v1 7B
Sakanaai · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
ELYZA Shortcut 1.0 Qwen 7B
Qwen · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · mmnga
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
ELYZA Thinking 1.0 Qwen 32B
Qwen · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
MA
Marco o1
Marco · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
EZO2.5 Gemma 3 12b It Preview
Gemma · mmnga
Params11.8B
Context128K
Q4_K_M7.3 GB
LI
lightblue karasu 7B chat plus unleashed
Lightblue · mmnga
Params7.96B
Context32K
Q4_K_M4.9 GB
JA
japanese stablelm base gamma 7b
Japanese · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
webbigdata ALMA 7B Ja
Webbigdata · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3 30B A3B NSFW JP
Qwen · mmnga
Params30.5B
Context32K
Q4_K_M18.6 GB
GE
Gemma 3 270m It
Gemma · mmnga
Params268M
Context32K
Q4_K_M0.3 GB
LL
ELYZA-japanese-Llama-2-7b-fast
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
PL
Plamo 2 1b
Plamo · mmnga
Params1.29B
Context10240K
Q4_K_M0.8 GB
JA
japanese-large-lm-1.7b-instruction-sft
Japanese · mmnga
Params1.77B
Context2K
Q4_K_M1.2 GB
LL
Llama 3.3 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
PL
Plamo 2 8b
Plamo · mmnga
Params9.12B
Context10240K
Q4_K_M5.6 GB
CO
codegemma-1.1-7b-it
Codegemma · mmnga
Params8.54B
Context8K
Q4_K_M5.3 GB
GP
gpt-neox-japanese-1.4b
Gpt · mmnga
Params1.41B
Context1K
Q4_K_M0.9 GB
OP
open-calm-7b
Open · mmnga
Params6.87B
Context2K
Q4_K_M4.4 GB
CA
calm2-7b-chat
Calm · mmnga
Params7.01B
Context32K
Q4_K_M4.3 GB
MI
Vezora Mistral 22B v0.1
Mistral · mmnga
Params22.2B
Context64K
Q4_K_M13.3 GB
SA
Sarashina2.1 1b
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
TI
TinySwallow 1.5B Instruct
Tinyswallow · mmnga
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
r1 1776 distill llama 70b
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · mmnga
Params12.2B
Context1000K
Q4_K_M7.5 GB