Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
GGUF
DE
deepseek coder v2 lite instruct
DeepSeek · mad-lab-ai
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
AU
Aurora Code 1
Aurora · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QU
QuasiStarSynth 12B Noslop Absolute Heresy
Quasistarsynth · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ES
MN 12B Estrella v1 i1
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
qwen3 coder 30b a3b
Qwen · AlexAtomic
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
RI
Rivermind Lux 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
GGUF
OP
s4sch_open-hermes-2.5-neural-chat-3.1-frankenmerge-11b
Open · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
Tool use
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningRoleplay
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B
Qwen · Distillio
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
SM
Smaug Humanizer
Smaug · abacusai
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
SO
T3Q ko solar dpo v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · legraphista
Params22.2B
Context64K
Smallest4.8 GB
CodingTool use
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
KA
Kalypso
Kalypso · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GR
Grug 27b
Grug · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
AR
Aryabhata 2.0
Aryabhata · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
GO
GonzaLomo Krea 2 v4.0 checkpoint
Gonzalomo · Quiho
Params12.8B
Context—
Smallest8.3 GB
GGUF
LU
Luminaura-RP-13B
Luminaura · mradermacher
Params13B
Context128K
Q4_K_M7.9 GB
Roleplay
GE
Gemma 4 Giftige Blume 31B v1
Gemma · Blazed-Forge
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
MA
MN 12B Mag Mell R1
Mag · inflatebot
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF

Other sizes

Keep browsing