Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
PH
Phi-4-Reasoning-Plus
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
LL
WizardLM 1.0 Uncensored Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
WI
Wicked Tutu 31B Final
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
AG
Agri 31b v1
Agri · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
WA
Wan2.2 Fun A14B InP
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
TE
Ternary Bonsai 2 27B Heretic Satellite
Ternary · HybridRMD
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · SummonGovernance
Params27.3B
Context256K
Smallest18.0 GB
GGUF
LT
LTX 2.5 Quantized
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
GGUF
JI
JiRackDeltaNet 27b
Jirackdeltanet · CMSManhattan
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
gemma 4 31B it scotoma 2
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
WH
whiterabbitneo_whiterabbitneo-13b
Whiterabbitneo · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 27B Abliterated GSQ Orca
Qwen · ayozhee
Params27.3B
Context256K
Smallest9.6 GB
GGUF
QW
Qwen3.8 27B Fable Distill Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.8 27B EfficientThink VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
DA
dasiwaWAN22I2V14B
Dasiwawan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen3.8 27B APEX
Qwen · mudler
Params27.3B
Context256K
Smallest11.2 GB
Vision
MI
MiniMax H3 Pruned Ref Delta Fused
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
DA
Dark Scarlett 27B v2.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
LF
LFM2.5 24B A2B
Lfm · bartowski
Params24B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
QW
Qwen3.6 27B MTP pi tune
Qwen · bytkim
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
LA
Laguna XS 2.1
Laguna · bartowski
Params33.4B
Context256K
Q4_K_M20.5 GB
GGUF
SC
SCAIL 2
Scail · Abiray
Params16.4B
Context—
Q4_K_M11.5 GB
GGUF
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · bartowski
Params26B
Context256K
Q4_K_M18.8 GB
ReasoningRoleplay
GR
GRM 2.6 Plus
Grm · morikomorizz
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision

Other sizes

Keep browsing