GGUF models by batiai

39 GGUF models quantized by batiai on Hugging Face. Sizes run from 596M to 1570B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistralai Mistral Medium 3.5 128B
Mistral · batiai
Params125B
Context256K
Smallest48.4 GB
ReasoningTool use
MI
MiniMaxAI MiniMax M2.7
Minimax · batiai
Params229B
Context192K
Smallest88.0 GB
ReasoningTool use
QW
Qwen Qwen3.5 27B
Qwen · batiai
Params26.9B
Context256K
Smallest15.1 GB
ReasoningTool use
NE
Nvidia NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool use
KI
Moonshotai Kimi K2.6
Kimi · batiai
Params1030B
Context256K
Smallest394.2 GB
ReasoningTool use
DE
Deepseek Ai DeepSeek V4 Pro
DeepSeek · batiai
Params1570B
Context1024K
Q4_K_M951.2 GB
Reasoning
DE
DeepSeek V4 Flash 0731
DeepSeek · batiai
Params92B
Context1024K
Smallest44.9 GB
GGUF
NE
Nvidia NVIDIA Nemotron 3 Super 120B A12B BF16
Nemotron · batiai
Params121B
Context1024K
Smallest56.8 GB
ReasoningTool use
KI
Kimi K2.7 Code
Kimi · batiai
Params1030B
Context256K
Smallest394.2 GB
CodingReasoningTool use

Keep browsing