Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
IN
Industry Coder 27B v1.0 BF16
Industry · kataguru
Params26.9B
Context256K
Q4_K_M2.0 GB
GO
Goetia 26B A4B v1.5
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
B3
B3 27B i1
mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B i1
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
State of the MoE RP 3x7b
State · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
DA
Darwin 27B RSI
Darwin · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AC
Acolyte 22B i1
Acolyte · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
SA
Sarvamai.Sarvam 30b
Sarvam · DevQuasar
Params32.2B
Context128K
Smallest12.2 GB
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
FR
Free Sydney V2 13B
Free · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 11B Instruct v0.1
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
GR
granite 34b code instruct
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
KN
Knight Miqu 27B MoE
Knight · mradermacher
Params27.9B
Context32K
Q4_K_M16.8 GB
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
PS
PsyMedLewdReMM Inverted 20B i1
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
OX
oxy 1 small i1
Oxy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SA
Sanad 1.0
Sanad · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Swift Qwen3.8 27B Uncensored MTP Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
QW
Qwen3.8 27B LowGPU uncensored NoMTP IQ3XXXS
Qwen · TheWegemann
Params27B
Context256K
Smallest9.6 GB
QW
Qwen3.5 27B RpRMax v1
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · Milad4545
Params27.3B
Context256K
Smallest3.2 GB
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
EV
EverythingLM 13b V2 16K
Everythinglm · TheBloke
Params13B
Context—
Q4_K_M6.3 GB