Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Swift Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
OM
Omega Arsenal 31B Final
Omega · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
Qwen3.8 27B
Qwen · DhruvalLabs
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
GE
Ablation 188 Gemma3.Webnovels.Test.Gemma 3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
ME
G4 MeroMero v2 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen2.5-14B-Instruct-1M
Qwen · Mungert
Params14.8B
Context986K
Q4_K_M9.2 GB
GGUF
QW
Qwen3.8 27B
Qwen · KikoCis
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8-27B GSQ-RCO
Qwen · cruizba
Params27.3B
Context256K
Smallest8.6 GB
GGUF
QW
Qwen3.8 27B Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 Coder 30B A3B
Qwen · AtomicChat
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
QW
Qwen3.8-27B-Abliterated
Qwen · windowsxp811203
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
LL
codellama_codellama-13b-instruct-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
NE
DictaLM 3.0 Nemotron 12B Instruct
Nemotron · dicta-il
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
ON
OneJev 27B
Onejev · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
FA
FastH3 Omni
Fasth · Abiray
Params22.1B
Context—
Q4_K_M12.7 GB
GGUF
WI
wizardlm_wizardcoder-python-34b-v1.0
Wizardcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
GGUF
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
ReasoningTool useVision
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
GL
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced
GLM · HauhauCS
Params30B
Context198K
Q4_K_M18.1 GB
GGUF

Other sizes

Keep browsing