GGUF models by mmnga
261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.
TO
tokyotech llm Swallow 7b instruct v0.1
Tokyotech · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
alfredplpl Llama 3 8B Instruct Ja
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llm Jp 3 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
LL
Llm Jp 3 8x1.8b Instruct3
Llm · mmnga
Params9.27B
Context4K
Q4_K_M5.7 GB
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
MA
mathstral-7B-v0.1
Mathstral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
VE
Vecteus v1
Vecteus · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
JA
japanese-large-lm-1.7b
Japanese · mmnga
Params1.77B
Context2K
Q4_K_M1.2 GB
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
LL
haqishen Llama 3 8B Japanese Instruct
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
SU
Superswallow 7b v0.1
Superswallow · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
NI
Ninja v1 128k
Ninja · mmnga
Params7.24B
Context128K
Q4_K_M4.4 GB
AI
aixsatoshi Honyaku Multi Translator Swallow ms7b
Aixsatoshi · mmnga
Params7.3B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
ST
stockmark 100b
Stockmark · mmnga
Params96.2B
Context4K
Smallest20.4 GB
SA
SakanaAI EvoLLM JP v1 7B
Sakanaai · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 70B Instruct
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
c4ai-command-r-plus
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB