Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
MI
Models Mistralai Mistral Small Instruct 2409
Mistral · MaziyarPanahi
Params22.2B
Context32K
Q4_K_M13.3 GB
LT
LTX 2.5 GGUFs
Ltx · realrebelai
Params21B
Context—
Q4_K_M15.1 GB
MI
Models Mistralai Mistral Small 24B Instruct 2501
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
MiniMax H3 curve
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
GP
Gpt Oss 20b Heretic
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Models Google Gemma 3 27b It
Gemma · MaziyarPanahi
Params27B
Context128K
Q4_K_M16.5 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M24.6 GB
QW
Models Qwen QwQ 32B
Qwen · MaziyarPanahi
Params32.8B
Context128K
Q4_K_M19.9 GB
GE
Gemma-3-27B-It
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
IN
Models PrimeIntellect INTELLECT 2
Intellect · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.9 GB
PH
phi 4
Phi · MaziyarPanahi
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
Text_Encoder
Qwen · pottokao
Params26.5B
Context256K
Smallest11.5 GB
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · dongfangshuo
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 31B
Gemma · lmstudio-community
Params30.7B
Context256K
Q4_K_M18.7 GB
WA
Wan2.1 T2V 14B
Wan · city96
Params14.3B
Context—
Q4_K_M10.1 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bartowski
Params32.9B
Context1024K
Q4_K_M25.5 GB
MI
Ministral 3 14B Instruct 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
TE
Ternary Bonsai 2 27B Abliterated v2 PQ2 0 MTP
Ternary · BoldingBuilds
Params26.9B
Context256K
Smallest7.2 GB
GE
Gemma 4 12B It
Gemma · bartowski
Params11.9B
Context128K
Q4_K_M7.7 GB
HE
Hemmingway 1
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
DI
diffusiongemma 26B A4B it
Diffusiongemma · unsloth
Params25.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 32B Abliterated
Qwen · RoadToNowhere
Params32.8B
Context40K
Q4_K_M19.8 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · groxaxo
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 14B Uncensored Instruct
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama 3.2 8X3B MOE Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB