Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Orthia-31B
Gemma · Nimbz
Params32B
Context256K
Q4_K_M19.8 GB
Roleplay
QW
Qwen2.5 Coder 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.8 27B
Qwen · SoAIHQ
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
RoleplayVision
BO
Boundary 4x7b MoE i1
Boundary · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Tool use
QW
ATX Swift 1.5 Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
GGUF
AI
jondurbin_airoboros-c34b-2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
QW
Qwen3.8 27B GSQ RCO IQ3 S recovered
Qwen · Joakimpalm-Zen
Params26.9B
Context256K
Smallest3.2 GB
ReasoningTool use
LL
code Llama 2 13B i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
Roleplay
GE
Gemma 4 26B A4B It SOMPOA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
SK
Skyfall 31B v4.2 Heretic
Skyfall · mradermacher
Params31.4B
Context128K
Q4_K_M19.0 GB
Coding
DA
Dark Scarlett 27B v3.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M23.5 GB
Roleplay
QW
Qwen2.5 Coder 14B Instruct Uncensored Q4 K M
Qwen · roleplaiapp
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
EX
EXAONE-4.0-32B
Exaone · LGAI-EXAONE
Params32B
Context128K
Q4_K_M19.3 GB
GGUF
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 12B It Heretic_Decensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · llmfan46
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeUp Llama 2 13B Chat HF
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.6 27B abliterated
Qwen · wangzhang
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
MixTaoTruthful-13B-slerp
Mixtaotruthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
ST
Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding

Other sizes

Keep browsing