Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · xrachelburns
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Huihui Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CA
causallm_14b
TheBloke
Params14.2B
Context8K
Smallest8.2 GB
Tool useVision
LO
LongCat Video Avatar ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.0 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct RTPurbo
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
TO
Torchcast Decision 27b
Torchcast · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Smallest16.0 GB
Vision
LA
Laguna-XS-2.1
Laguna · ggml-org
Params33.4B
Context256K
Q4_K_M19.6 GB
GGUF
UN
UnslopNemo 12B v4.1
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
codellama_codellama-13b-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
NO
Nous Hermes 2 SOLAR 10.7B
Nous · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
SE
SenseNova U1 8B MoT Merger
Sensenova · smthem
Params17.6B
Context—
Smallest13.9 GB
GGUF
LL
Speechless Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
AE
AesCode 32B
Aescode · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Coding
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
FL
FLUX.1 schnell
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
Coding
QW
Qwen3.8-27B
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
GGUF
CL
Clef
Clef · abenzerps
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context256K
Smallest12.6 GB
Vision
AR
AREX 2 i1
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled Reap
Qwen · brunopio
Params14.1B
Context256K
Q4_K_M8.7 GB
Reasoning
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
PH
Phi 4 Reasoning Plus
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
QW
qwen image
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
CL
Clef Artemis
Clef · turintech
Params27B
Context256K
Smallest10.5 GB
ReasoningTool use
QW
Qwen2.5 14B Instruct
Qwen · TheRains
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use

Other sizes

Keep browsing