Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
NE
NeuralMona MoE 4x7B i1
Neuralmona · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
LT
LTX 2.3 test
Ltx · smthem
Params12.2B
Context—
Smallest8.7 GB
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · noctrex
Params25.2B
Context256K
Smallest15.4 GB
LT
LTX 2.5 Distilled
Ltx · FenomAI
Params21B
Context—
Q4_K_M15.7 GB
JE
Jeffan 31b 1710
Jeffan · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
PS
Psyonic-Cetacean-full-precision
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
TE
Ternary Bonsai 2 27B Abliterated swift cap PQ2 0 MTP
Ternary · hotdogs
Params27.3B
Context256K
Smallest7.6 GB
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
TI
Tifa Deepsex 14b CoT GGUF Q4
Tifa · ValueFX9507
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Agrillm Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
NO
Nous Hermes 13B Code
Nous · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NA
Nanbeige4.3 33B Base
Nanbeige · nesymerp1
Params33.1B
Context128K
Q4_K_M20.1 GB
SE
Sexpedition MS3.2 24B
Sexpedition · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
QW
Qwen3 Coder 30B APEX
Qwen · mudler
Params30.5B
Context256K
Smallest12.1 GB
EQ
Equinox 31B
Equinox · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ME
Hy Memory 30B A3B
Memory · vinnipukh
Params30B
Context256K
Q4_K_M18.2 GB
WA
Magic Wan Image V2
Wan · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q4 K M
Nemotron · mlasli
Params31.6B
Context1024K
Q4_K_M24.5 GB
BA
bagel dpo 20b v04 i1
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
OM
Omega Evolution 31b v4.0
Omega · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 Coder 30B A3B Instruct Westernized
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
SW
Swish 31B Final
Swish · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
FastVideo FastH3 8 Step V2 ComfyUI
Minimax · vantagewithai
Params22B
Context—
Q4_K_M13.6 GB
QW
Qwen2.5-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB