Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B TurboFCFusion CyberSec
Qwen · bbkdevops
Params27.3B
Context256K
Smallest17.8 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 OS INSTRUCT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
Coding
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AV
Avenger2.01-xb-Passthrough
Avenger · mradermacher
Params12.3B
Context32K
Q4_K_M7.4 GB
GGUF
CH
elinas_chronos-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GR
Granite 4.2 30b
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
CodingVision
IN
amd.Instella MoE 16B A3B Think
Instella · DevQuasar
Params15.9B
Context32K
Smallest6.5 GB
Reasoning
QW
Qwen3.6 27B Tachibana Agent
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoning
ON
OneDecision VisionGuard 27B SFT
Onedecision · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3 33B A3B Quad Mind
Qwen · mradermacher
Params33B
Context32K
Q4_K_M20.1 GB
ReasoningRoleplay
MY
MySelectedLLMs
Myselectedllms · wingbrother
Params25.2B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
PH
Phi4.React.Turn.V2.Full i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
GGUF
WI
Wicked Tutu 26B A4B
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
GE
Gemma 4 12B It Heretic NVFP4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
Vision
GE
Gemma 4 31B It Scotoma 2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MI
Mistral Nemo 12B Instruct 2407
Mistral · starble-dev
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
ThinkingCap Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.8 27B ScientificBM
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
Mixnu i1
Mixnu · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
GGUF
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
GGUF
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
Coding
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF

Other sizes

Keep browsing