Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GP
gpt 5.6 sol undecillion 6u5go5
Gpt · oroboros-labs
Params27.3B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
GGUF
QW
Qwen3.5 Creative 19B A3B REAP
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
GGUF
GE
gemma4 comfyui mcp
Gemma · artokun
Params11.9B
Context128K
Q4_K_M3.4 GB
CodingTool use
LT
LTX2.3 10Eros 1.3
Ltx · chfm
Params21B
Context—
Q4_K_M14.3 GB
GGUF
FI
Fimbulvetr 11B v2
Fimbulvetr · Sao10K
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
RE
ReflectionCoder DS 33B
Reflectioncoder · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
HY
HyperCLOVAX-SEED-Think-14B
Hyperclovax · naver-ellm
Params14.7B
Context128K
Q4_K_M8.9 GB
Reasoning
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 14b Heretic v2
Qwen · FoPlayerBlock
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwopus3.6 27B v1 Abliterated Preview
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
NE
Nemotron 3.5 Bolt 74B A9B 16GB
Nemotron · anik-jha
Params24.4B
Context256K
Smallest9.1 GB
CodingReasoningTool use
SN
Snowpiercer 15B v1
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Roleplay
QW
Qwen3 Coder 30B A3B Instruct
Qwen · n00b001
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
UwU Qwen3.5 27B v0.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
RO
Rocinante X 12B v1 Heretic Uncensored
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M10.6 GB
CodingVision

Other sizes

Keep browsing