Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
GGUF
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.6 35B A3B coding reap50
Qwen · anik-jha
Params18.5B
Context256K
Q4_K_M11.4 GB
Coding
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
CH
Chronos Divergence 33B
Chronos · bartowski
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
GE
Gemma 4 31B It Heretic
Gemma · NeuralDreamer
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingVision
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
GGUF
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
NousCoder 14B
Nouscoder · bartowski
Params14.8B
Context80K
Q4_K_M9.0 GB
Coding
QW
Qwen3 48B A4B Savant Commander Distill 12X Closed Open Heretic Uncensored
Qwen · DavidAU
Params33.6B
Context256K
Q4_K_M20.4 GB
Reasoning
WI
Wicked Tutu 31B v2.0
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
RW
rwkv7-g1k-13.3b-20260930-ctx25600.pth
Rwkv · shoumenchougou
Params13.3B
Context1024K
Q4_K_M8.5 GB
GGUF
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3.6 28B REAP20 A3B Merged Bf16
Qwen · barozp
Params28.2B
Context256K
Q4_K_M17.3 GB
GGUF
GP
GPT4 X Alpasta 30b i1
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · tngtech
Params31.6B
Context1024K
Smallest2.0 GB
GGUF
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
SI
Hy-SimulMT-30B-A3B-Interleave
Simulmt · tencent
Params30.4B
Context256K
Q4_K_M19.7 GB
ReasoningTool use
GP
Gpt Oss Sanguine 20b v1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
CodingReasoningRoleplay
QW
Qwen3 30B A3B ERP v0.1
Qwen · Aratako
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
CH
Chaotic Order V4
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF

Other sizes

Keep browsing