Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
Persephone Flux 2.0 Q8
Flux · pyys
Params11.9B
Context—
Smallest12.7 GB
GGUF
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Uncensored i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
GGUF
AU
Augmental 13B v1.50 B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AL
Hy MT2 30B A3B
Alphazimuth · alphaZimuth
Params30B
Context256K
Smallest12.4 GB
GGUF
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
CO
ConfigurableSOLAR 10.7B i1
Configurablesolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
WA
WanT2IHighRealism2.2
Want · Kolso14
Params14.3B
Context—
Smallest15.4 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Notyourmom1
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
GGUF
GR
Groot 19B A3B 261023
Groot · GrootTeam
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool useVision
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
Coding
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
DA
MN Dark Horror The Cliffhanger 18.5B
Dark · DavidAU
Params18.5B
Context1000K
Q4_K_M11.2 GB
Roleplay
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
TE
Ternary Bonsai 2 27B Abliterated PTQ1 0 MTP Q4 0
Ternary · Cheurteen
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
SE
Semancer 12B
Semancer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
WA
Wan22nsfwenhanced
Wan · Cassanovason69
Params14.3B
Context—
Smallest15.4 GB
GGUF
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
FL
FLUX.1 Depth dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool useVision
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
MU
Murasaki Backup
Murasaki · shoutmon
Params14.8B
Context32K
Smallest3.6 GB
GGUF

Other sizes

Keep browsing