GGUF models by batiai
39 GGUF models quantized by batiai on Hugging Face. Sizes run from 596M to 1570B parameters. The longest trained context is 10240K tokens.
MI
Mistralai Mistral Medium 3.5 128B
Mistral · batiai
Params125B
Context256K
Smallest48.4 GB
MI
MiniMaxAI MiniMax M2.7
Minimax · batiai
Params229B
Context192K
Smallest88.0 GB
QW
Qwen Qwen3.5 27B
Qwen · batiai
Params26.9B
Context256K
Smallest15.1 GB
NE
Nvidia NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
KI
Moonshotai Kimi K2.6
Kimi · batiai
Params1030B
Context256K
Smallest394.2 GB
DE
Deepseek Ai DeepSeek V4 Pro
DeepSeek · batiai
Params1570B
Context1024K
Q4_K_M951.2 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · batiai
Params92B
Context1024K
Smallest44.9 GB
NE
Nvidia NVIDIA Nemotron 3 Super 120B A12B BF16
Nemotron · batiai
Params121B
Context1024K
Smallest56.8 GB
KI
Kimi K2.7 Code
Kimi · batiai
Params1030B
Context256K
Smallest394.2 GB