GGUF models by mmnga
261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LI
Light R1 32B
Light · mmnga
Params32.8B
Context42K
Q4_K_M19.9 GB
KA
Karakuri Vl 32b Instruct 2507
Karakuri · mmnga
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
ABEJA Qwen2.5 32b Japanese v1.0
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
PH
EZO Phi 4 V2_900
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
RI
rinna youri 7b chat
Rinna · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
llm jp 1.8bx24 combined
Llm · mmnga
Params26.2B
Context4K
Q4_K_M15.9 GB
CO
C4Ai Command R Plus 08 2024
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GE
gemma-2b-it
Gemma · mmnga
Params2.51B
Context8K
Q4_K_M1.5 GB
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mmnga
Params3.88B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Bakeneko 32b Instruct
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
AR
ArrowNeo AME 3x4B v0.1 MoE
Arrowneo · mmnga
Params7.76B
Context8K
Q4_K_M4.7 GB
PH
Phi 4 Reasoning Plus
Phi · mmnga
Params14.7B
Context32K
Q4_K_M9.1 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · mmnga
Params32.8B
Context128K
Q4_K_M19.8 GB
CO
C4Ai Command A 03 2025
Command R · mmnga
Params111B
Context128K
Smallest24.6 GB
RI
rinna nekomata 14b instruction
Rinna · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
JA
japanese stablelm instruct ja vocab beta 7b
Japanese · mmnga
Params6.88B
Context4K
Q4_K_M4.2 GB
RA
RakutenAI 2.0 8x7B Instruct
Rakutenai · mmnga
Params46.8B
Context32K
Q4_K_M28.5 GB
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mmnga
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
AXCXEPT QwQ 32B Distill Qwen 1.5B Alpha
Qwen · mmnga
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
llm-jp-13b-instruct-full-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
LL
Llm Jp 3 13b
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
MA
matsuolab weblab 10b instruction sft
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · mmnga
Params108B
Context10240K
Smallest22.2 GB
DE
Deepreneur blue lizard
Deepreneur · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2.5 72B Instruct
Qwen · mmnga
Params72.7B
Context32K
Q4_K_M47.4 GB
KA
Karakuri Vl 32b Thinking 2507 Exp
Karakuri · mmnga
Params32.8B
Context125K
Q4_K_M19.9 GB
LL
llm-jp-13b-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB