Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B TurboFCFusion CyberSec
Qwen · bbkdevops
Params27.3B
Context256K
Smallest17.8 GB
QW
Qwen3.5 27B Claude 4.6 OS INSTRUCT
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
AV
Avenger2.01-xb-Passthrough
Avenger · mradermacher
Params12.3B
Context32K
Q4_K_M7.4 GB
CH
elinas_chronos-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GR
Granite 4.2 30b
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
IN
amd.Instella MoE 16B A3B Think
Instella · DevQuasar
Params15.9B
Context32K
Smallest6.5 GB
QW
Qwen3.6 27B Tachibana Agent
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ON
OneDecision VisionGuard 27B SFT
Onedecision · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 33B A3B Quad Mind
Qwen · mradermacher
Params33B
Context32K
Q4_K_M20.1 GB
MY
MySelectedLLMs
Myselectedllms · wingbrother
Params25.2B
Context256K
Q4_K_M5.6 GB
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
PH
Phi4.React.Turn.V2.Full i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
WI
Wicked Tutu 26B A4B
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
GE
Gemma 4 12B It Heretic NVFP4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Mistral Nemo 12B Instruct 2407
Mistral · starble-dev
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
ThinkingCap Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 27B ScientificBM
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mixnu i1
Mixnu · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB