Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GP
gpt 5.6 sol undecillion 6u5go5
Gpt · oroboros-labs
Params27.3B
Context256K
Smallest0.9 GB
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
QW
Qwen3.5 Creative 19B A3B REAP
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
GE
gemma4 comfyui mcp
Gemma · artokun
Params11.9B
Context128K
Q4_K_M3.4 GB
LT
LTX2.3 10Eros 1.3
Ltx · chfm
Params21B
Context—
Q4_K_M14.3 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · Sao10K
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
RE
ReflectionCoder DS 33B
Reflectioncoder · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
HY
HyperCLOVAX-SEED-Think-14B
Hyperclovax · naver-ellm
Params14.7B
Context128K
Q4_K_M8.9 GB
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3 14b Heretic v2
Qwen · FoPlayerBlock
Params14.8B
Context40K
Q4_K_M9.0 GB
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwopus3.6 27B v1 Abliterated Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
Nemotron 3.5 Bolt 74B A9B 16GB
Nemotron · anik-jha
Params24.4B
Context256K
Smallest9.1 GB
SN
Snowpiercer 15B v1
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · n00b001
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
UwU Qwen3.5 27B v0.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RO
Rocinante X 12B v1 Heretic Uncensored
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M10.6 GB