Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
WR
writing roleplay 20k context nemo 12b v1.0
Writing · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
L3 DARKEST PLANET Seven Rings Of DOOM 16.5B
Darkest · DavidAU
Params16.5B
Context8K
Q4_K_M10.0 GB
QW
Josiefied Qwen3 30B A3B Abliterated v1
Qwen · Disya
Params30.5B
Context40K
Q4_K_M18.6 GB
FL
FLUX.1 dev FluxedUp V10
Flux · h4shy
Params11.9B
Context—
Smallest6.8 GB
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · DavidAU
Params12.15B
Context8K
Q4_K_M7.4 GB
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
QW
Qwen3.8 27B Uncensored Heretic v2
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
QW
Qwen3.8 27B
Qwen · arbonquants
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Hemmingway 1 Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It Claude Opus Distill v2
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
GL
GLM 4.7 Flash
GLM · evilfreelancer
Params29.9B
Context198K
Q4_K_M18.1 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen Image Edit 2511
Qwen · w3ss
Params20.4B
Context—
Q4_K_M13.2 GB
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
QW
trashpanda org QwQ 32B Snowdrop v0
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
ElisNovel V2 14B
Qwen · cyanelis
Params14.8B
Context40K
Q4_K_M9.0 GB
FL
Flux Fusion DS merge gguf nf4 fp4 fp8 fp16
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
QW
claude opus 9 undecillion 9u5go5 sse
Qwen · oroboros-labs
Params27.3B
Context256K
Smallest16.8 GB
CY
Cydonia 24B v4.3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NE
NemoMix Unleashed 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · bullerwins
Params25.2B
Context256K
Q4_K_M16.8 GB
HE
Hemlock Philter 14B
Hemlock · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB