GGUF models by mmnga

261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
ABEJA Qwen2.5 7b Japanese v0.1
Qwen · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LL
Llama 3.1 Swallow 8B Instruct v0.1
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SakanaAI EvoLLM JP A v1 7B
Sakanaai · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ELYZA Shortcut 1.0 Qwen 7B
Qwen · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · mmnga
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
QW
ELYZA Thinking 1.0 Qwen 32B
Qwen · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 32B Japanese
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MA
Marco o1
Marco · mmnga
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
EZO2.5 Gemma 3 12b It Preview
Gemma · mmnga
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
LI
lightblue karasu 7B chat plus unleashed
Lightblue · mmnga
Params7.96B
Context32K
Q4_K_M4.9 GB
GGUF
JA
japanese stablelm base gamma 7b
Japanese · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
webbigdata ALMA 7B Ja
Webbigdata · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 30B A3B NSFW JP
Qwen · mmnga
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningTool use
GE
Gemma 3 270m It
Gemma · mmnga
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-fast
Llama · mmnga
Params6.85B
Context4K
Q4_K_M4.2 GB
GGUF
PL
Plamo 2 1b
Plamo · mmnga
Params1.29B
Context10240K
Q4_K_M0.8 GB
GGUF
JA
japanese-large-lm-1.7b-instruction-sft
Japanese · mmnga
Params1.77B
Context2K
Q4_K_M1.2 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
PL
Plamo 2 8b
Plamo · mmnga
Params9.12B
Context10240K
Q4_K_M5.6 GB
GGUF
CO
codegemma-1.1-7b-it
Codegemma · mmnga
Params8.54B
Context8K
Q4_K_M5.3 GB
Coding
GP
gpt-neox-japanese-1.4b
Gpt · mmnga
Params1.41B
Context1K
Q4_K_M0.9 GB
GGUF
OP
open-calm-7b
Open · mmnga
Params6.87B
Context2K
Q4_K_M4.4 GB
GGUF
CA
calm2-7b-chat
Calm · mmnga
Params7.01B
Context32K
Q4_K_M4.3 GB
GGUF
MI
Vezora Mistral 22B v0.1
Mistral · mmnga
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
SA
Sarashina2.1 1b
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
TI
TinySwallow 1.5B Instruct
Tinyswallow · mmnga
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
r1 1776 distill llama 70b
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
MI
Mistral Nemo Japanese Instruct 2408
Mistral · mmnga
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing