Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Coder 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
PH
Phi-4-Reasoning-Plus
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
LL
WizardLM 1.0 Uncensored Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
WI
Wicked Tutu 31B Final
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
AG
Agri 31b v1
Agri · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
WA
Wan2.2 Fun A14B InP
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
TE
Ternary Bonsai 2 27B Heretic Satellite
Ternary · HybridRMD
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
Qwen · SummonGovernance
Params27.3B
Context256K
Smallest18.0 GB
LT
LTX 2.5 Quantized
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
JI
JiRackDeltaNet 27b
Jirackdeltanet · CMSManhattan
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 31B it scotoma 2
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
WH
whiterabbitneo_whiterabbitneo-13b
Whiterabbitneo · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3.8 27B Abliterated GSQ Orca
Qwen · ayozhee
Params27.3B
Context256K
Smallest9.6 GB
QW
Qwen3.8 27B Fable Distill Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B EfficientThink VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
DA
dasiwaWAN22I2V14B
Dasiwawan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen3.8 27B APEX
Qwen · mudler
Params27.3B
Context256K
Smallest11.2 GB
MI
MiniMax H3 Pruned Ref Delta Fused
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
DA
Dark Scarlett 27B v2.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
LF
LFM2.5 24B A2B
Lfm · bartowski
Params24B
Context128K
Q4_K_M15.4 GB
QW
Qwen3.6 27B MTP pi tune
Qwen · bytkim
Params27.3B
Context256K
Q4_K_M16.8 GB
LA
Laguna XS 2.1
Laguna · bartowski
Params33.4B
Context256K
Q4_K_M20.5 GB
SC
SCAIL 2
Scail · Abiray
Params16.4B
Context—
Q4_K_M11.5 GB
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · bartowski
Params26B
Context256K
Q4_K_M18.8 GB
GR
GRM 2.6 Plus
Grm · morikomorizz
Params27B
Context256K
Q4_K_M16.5 GB