Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralMona MoE 4x7B i1
Neuralmona · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
LT
LTX 2.3 test
Ltx · smthem
Params12.2B
Context—
Smallest8.7 GB
GGUF
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · noctrex
Params25.2B
Context256K
Smallest15.4 GB
Vision
LT
LTX 2.5 Distilled
Ltx · FenomAI
Params21B
Context—
Q4_K_M15.7 GB
GGUF
JE
Jeffan 31b 1710
Jeffan · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
ReasoningTool useVision
PS
Psyonic-Cetacean-full-precision
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated swift cap PQ2 0 MTP
Ternary · hotdogs
Params27.3B
Context256K
Smallest7.6 GB
ReasoningVision
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
TI
Tifa Deepsex 14b CoT GGUF Q4
Tifa · ValueFX9507
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Agrillm Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
NO
Nous Hermes 13B Code
Nous · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CodingTool use
NA
Nanbeige4.3 33B Base
Nanbeige · nesymerp1
Params33.1B
Context128K
Q4_K_M20.1 GB
GGUF
SE
Sexpedition MS3.2 24B
Sexpedition · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
QW
Qwen3 Coder 30B APEX
Qwen · mudler
Params30.5B
Context256K
Smallest12.1 GB
Coding
EQ
Equinox 31B
Equinox · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
ME
Hy Memory 30B A3B
Memory · vinnipukh
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
WA
Magic Wan Image V2
Wan · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q4 K M
Nemotron · mlasli
Params31.6B
Context1024K
Q4_K_M24.5 GB
Roleplay
BA
bagel dpo 20b v04 i1
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
OM
Omega Evolution 31b v4.0
Omega · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
ReasoningTool useVision
QW
Qwen3 Coder 30B A3B Instruct Westernized
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
SW
Swish 31B Final
Swish · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
MI
FastVideo FastH3 8 Step V2 ComfyUI
Minimax · vantagewithai
Params22B
Context—
Q4_K_M13.6 GB
GGUF
QW
Qwen2.5-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision

Other sizes

Keep browsing