GGUF models by mmnga
261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.
PF
pfnet nekomata 14b pfn qfin
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
LL
Llm Jp 3 7.2b
Llm · mmnga
Params7.29B
Context4K
Q4_K_M4.5 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
NI
Ninja v1
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
LL
llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mmnga
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
LL
rinna llama 3 youko 8b
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
MI
lightblue Karasu Mixtral 8x22B v0.1
Mistral · mmnga
Params141B
Context64K
Smallest29.6 GB
LL
Llm Jp 3 980m Instruct3
Llm · mmnga
Params990M
Context4K
Q4_K_M0.6 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
ELYZA japanese CodeLlama 7b
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
ELYZA japanese CodeLlama 7b instruct
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
PF
pfnet nekomata 14b pfn qfin inst merge
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
RA
RakutenAI 7B instruct
Rakutenai · mmnga
Params7.37B
Context32K
Q4_K_M4.5 GB
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · mmnga
Params13.1B
Context4K
Q4_K_M8.0 GB
LL
Meta Llama 3 8B Instruct
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
QwQ 32B Preview
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · mmnga
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
ELYZA-japanese-Llama-2-7b-instruct
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB