GGUF models by mmnga

261 GGUF models quantized by mmnga on Hugging Face. Sizes run from 268M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LI
Light R1 32B
Light · mmnga
Params32.8B
Context42K
Q4_K_M19.9 GB
ReasoningTool use
KA
Karakuri Vl 32b Instruct 2507
Karakuri · mmnga
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
ABEJA Qwen2.5 32b Japanese v1.0
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
PH
EZO Phi 4 V2_900
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
RI
rinna youri 7b chat
Rinna · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
llm jp 1.8bx24 combined
Llm · mmnga
Params26.2B
Context4K
Q4_K_M15.9 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GGUF
GE
gemma-2b-it
Gemma · mmnga
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mmnga
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen2.5 Bakeneko 32b Instruct
Qwen · mmnga
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
AR
ArrowNeo AME 3x4B v0.1 MoE
Arrowneo · mmnga
Params7.76B
Context8K
Q4_K_M4.7 GB
Tool use
PH
Phi 4 Reasoning Plus
Phi · mmnga
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
QW
Cogito v1 Preview Qwen 32B
Qwen · mmnga
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningTool use
CO
C4Ai Command A 03 2025
Command R · mmnga
Params111B
Context128K
Smallest24.6 GB
Tool use
RI
rinna nekomata 14b instruction
Rinna · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
JA
japanese stablelm instruct ja vocab beta 7b
Japanese · mmnga
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
RA
RakutenAI 2.0 8x7B Instruct
Rakutenai · mmnga
Params46.8B
Context32K
Q4_K_M28.5 GB
GGUF
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mmnga
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
AXCXEPT QwQ 32B Distill Qwen 1.5B Alpha
Qwen · mmnga
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
llm-jp-13b-instruct-full-dolly-oasst-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF
LL
Llm Jp 3 13b
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
MA
matsuolab weblab 10b instruction sft
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · mmnga
Params108B
Context10240K
Smallest22.2 GB
Tool use
DE
Deepreneur blue lizard
Deepreneur · mmnga
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · mmnga
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
KA
Karakuri Vl 32b Thinking 2507 Exp
Karakuri · mmnga
Params32.8B
Context125K
Q4_K_M19.9 GB
ReasoningVision
LL
llm-jp-13b-v1.0
Llm · mmnga
Params13.1B
Context2K
Q4_K_M8.4 GB
GGUF

Keep browsing