Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Q8 0
Qwen · Chungulus
Params27.3B
Context256K
Smallest29.0 GB
ReasoningTool useVision
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
MA
magnum v4 12b
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
GGUF
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
SH
shisa v2.1 unphi4 14b
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
Reasoning
WI
WizardCoder 15B V1.0
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
GE
Gemma 4 31B It Claude Opus Distill
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
RI
RICO
Rico · darkc0de
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3-Vl-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
Vision
NA
Nanbeige4.3 33B
Nanbeige · mradermacher
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GL
L3 V2 S M B Grand HORROR 17B GLM4.7 Thinking UNCENSORED NEO Imatrix
GLM · DavidAU
Params16.5B
Context8K
Q4_K_M10.1 GB
ReasoningRoleplay
GE
gemma 4 26B A4B it ara abliterated
Gemma · jenerallee78
Params25.2B
Context256K
Smallest20.6 GB
Vision
ST
starcoder2-15b
StarCoder · QuantFactory
Params16B
Context16K
Q4_K_M9.9 GB
Coding
MI
MiniMax H3
Minimax · ldov
Params20.1B
Context—
Q4_K_M18.2 GB
GGUF
MI
grok oss Apollyon 24B
Mistral · c4tdr0ut
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Qwen3 30B A3B Thinking 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
GE
Gemma 3 12b It Abliterated
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
CI
Cirque 12B
Cirque · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
HA
Harbinger 24B
Harbinger · LatitudeGames
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
NA
Nanbeige4.3 33B Base
Nanbeige · mradermacher
Params33.1B
Context128K
Q4_K_M20.1 GB
GGUF

Other sizes

Keep browsing