GGUF models by mmnga

261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PF
pfnet nekomata 14b pfn qfin
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
LL
Llm Jp 3 7.2b
Llm · mmnga
Params7.29B
Context4K
Q4_K_M4.5 GB
GGUF
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
aixsatoshi Llama 3 8b Cosmopedia japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NI
Ninja v1
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
LL
llm-jp-13b-instruct-full-jaster-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · mmnga
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mmnga
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama-3-Swallow-8B-Instruct-v0.1
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
rinna llama 3 youko 8b
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
lightblue Karasu Mixtral 8x22B v0.1
Mistral · mmnga
Params141B
Context64K
Smallest29.6 GB
GGUF
LL
Llm Jp 3 980m Instruct3
Llm · mmnga
Params990M
Context4K
Q4_K_M0.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · mmnga
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
LL
ELYZA japanese CodeLlama 7b
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
ELYZA japanese CodeLlama 7b instruct
Llama · mmnga
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3.1 Swallow 8B Instruct v0.2
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PF
pfnet nekomata 14b pfn qfin inst merge
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
RA
RakutenAI 7B instruct
Rakutenai · mmnga
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · mmnga
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
QwQ 32B Preview
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · mmnga
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
ELYZA-japanese-Llama-2-7b-instruct
Llama · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 Swallow 8B Instruct v0.3
Llama · mmnga
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF

Keep browsing