Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Models Mistralai Mistral Small Instruct 2409
Mistral · MaziyarPanahi
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LT
LTX 2.5 GGUFs
Ltx · realrebelai
Params21B
Context—
Q4_K_M15.1 GB
GGUF
MI
Models Mistralai Mistral Small 24B Instruct 2501
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
MI
MiniMax H3 curve
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
GGUF
GP
Gpt Oss 20b Heretic
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB
CodingReasoning
QW
Qwen2.5 Coder 14B Instruct
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
GE
Models Google Gemma 3 27b It
Gemma · MaziyarPanahi
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
NE
Nemotron-3-Nano-30B-A3B
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M24.6 GB
Coding
QW
Models Qwen QwQ 32B
Qwen · MaziyarPanahi
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GE
Gemma-3-27B-It
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
Vision
IN
Models PrimeIntellect INTELLECT 2
Intellect · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.9 GB
GGUF
PH
phi 4
Phi · MaziyarPanahi
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
QW
Text_Encoder
Qwen · pottokao
Params26.5B
Context256K
Smallest11.5 GB
CodingVision
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
Vision
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · dongfangshuo
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
GE
Gemma 4 31B
Gemma · lmstudio-community
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
WA
Wan2.1 T2V 14B
Wan · city96
Params14.3B
Context—
Q4_K_M10.1 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bartowski
Params32.9B
Context1024K
Q4_K_M25.5 GB
GGUF
MI
Ministral 3 14B Instruct 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
TE
Ternary Bonsai 2 27B Abliterated v2 PQ2 0 MTP
Ternary · BoldingBuilds
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
GE
Gemma 4 12B It
Gemma · bartowski
Params11.9B
Context128K
Q4_K_M7.7 GB
Vision
HE
Hemmingway 1
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GGUF
DI
diffusiongemma 26B A4B it
Diffusiongemma · unsloth
Params25.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 32B Abliterated
Qwen · RoadToNowhere
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · groxaxo
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 14B Uncensored Instruct
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama 3.2 8X3B MOE Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
Roleplay

Other sizes

Keep browsing