Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen3.6 35B A3B coding reap50
Qwen · anik-jha
Params18.5B
Context256K
Q4_K_M11.4 GB
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
GE
Gemma 4 31B It Heretic
Gemma · NeuralDreamer
Params30.7B
Context256K
Q4_K_M18.7 GB
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
QW
Qwen3 48B A4B Savant Commander Distill 12X Closed Open Heretic Uncensored
Qwen · DavidAU
Params33.6B
Context256K
Q4_K_M20.4 GB
WI
Wicked Tutu 31B v2.0
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
RW
rwkv7-g1k-13.3b-20260930-ctx25600.pth
Rwkv · shoumenchougou
Params13.3B
Context1024K
Q4_K_M8.5 GB
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen3.6 28B REAP20 A3B Merged Bf16
Qwen · barozp
Params28.2B
Context256K
Q4_K_M17.3 GB
GP
GPT4 X Alpasta 30b i1
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · tngtech
Params31.6B
Context1024K
Smallest2.0 GB
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Q4_K_M10.5 GB
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SI
Hy-SimulMT-30B-A3B-Interleave
Simulmt · tencent
Params30.4B
Context256K
Q4_K_M19.7 GB
GP
Gpt Oss Sanguine 20b v1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Qwen3 30B A3B ERP v0.1
Qwen · Aratako
Params30.5B
Context32K
Q4_K_M18.6 GB
CH
Chaotic Order V4
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB