GGUF models by mmnga

261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
tokyotech llm Swallow 7b instruct v0.1
Tokyotech · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
alfredplpl Llama 3 8B Instruct Ja
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llm Jp 3 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
LL
Llm Jp 3 8x1.8b Instruct3
Llm · mmnga
Params9.27B
Context4K
Q4_K_M5.7 GB
GGUF
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MA
mathstral-7B-v0.1
Mathstral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Vecteus v1
Vecteus · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
JA
japanese-large-lm-1.7b
Japanese · mmnga
Params1.77B
Context2K
Q4_K_M1.2 GB
GGUF
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
LL
haqishen Llama 3 8B Japanese Instruct
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SU
Superswallow 7b v0.1
Superswallow · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
NI
Ninja v1 128k
Ninja · mmnga
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
AI
aixsatoshi Honyaku Multi Translator Swallow ms7b
Aixsatoshi · mmnga
Params7.3B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stockmark 100b
Stockmark · mmnga
Params96.2B
Context4K
Smallest20.4 GB
GGUF
SA
SakanaAI EvoLLM JP v1 7B
Sakanaai · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CO
c4ai-command-r-plus
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GGUF

Keep browsing