Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WR
writing roleplay 20k context nemo 12b v1.0
Writing · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
DA
L3 DARKEST PLANET Seven Rings Of DOOM 16.5B
Darkest · DavidAU
Params16.5B
Context8K
Q4_K_M10.0 GB
Roleplay
QW
Josiefied Qwen3 30B A3B Abliterated v1
Qwen · Disya
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
FL
FLUX.1 dev FluxedUp V10
Flux · h4shy
Params11.9B
Context—
Smallest6.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · DavidAU
Params12.15B
Context8K
Q4_K_M7.4 GB
Roleplay
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
QW
Qwen3.8 27B Uncensored Heretic v2
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
Vision
QW
Qwen3.8 27B
Qwen · arbonquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
QW
Hemmingway 1 Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 31B It Claude Opus Distill v2
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
GL
GLM 4.7 Flash
GLM · evilfreelancer
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image Edit 2511
Qwen · w3ss
Params20.4B
Context—
Q4_K_M13.2 GB
GGUF
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
QW
trashpanda org QwQ 32B Snowdrop v0
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
QW
ElisNovel V2 14B
Qwen · cyanelis
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
FL
Flux Fusion DS merge gguf nf4 fp4 fp8 fp16
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
claude opus 9 undecillion 9u5go5 sse
Qwen · oroboros-labs
Params27.3B
Context256K
Smallest16.8 GB
ReasoningTool use
CY
Cydonia 24B v4.3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NemoMix Unleashed 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · bullerwins
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
HE
Hemlock Philter 14B
Hemlock · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
LL
LLaMA2 13B Tiefighter
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other sizes

Keep browsing