Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Ingot XIII 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.8-27B
Qwen · 6block
Params27B
Context256K
Q4_K_M17.7 GB
Vision
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Q4_K_M21.5 GB
Reasoning
QW
Qwen_Qwen3 VL 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
CodingVision
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · dongfangshuo
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
LT
LTX2.3 10Eros 1.5
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
QW
sakura-14b-qwen3-v1.5
Qwen · SakuraLLM
Params14.8B
Context32K
Smallest8.2 GB
GGUF
SM
smoothMixWan22 I2V
Smoothmixwan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
CodingEmbedding
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
SA
Sakura GalTransl 14B v3.8
Sakura · SakuraLLM
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
TE
Tess 4.5 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
Vision
ME
MedGo i1
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · bullerwins
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LT
LTX 2.5 uncensored v1.1 FP8
Ltx · frtertaer
Params21B
Context—
Q4_K_M7.5 GB
GGUF
QW
Ternary Bonsai 2 27B gguf dev
Qwen · prism-ml
Params27B
Context256K
Smallest7.6 GB
GGUF
LL
openassistant_codellama-13b-oasst-sft-v10
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
ST
StartLux Decision v1 27B Q8 0
Startlux · startlux-models
Params27B
Context256K
Smallest28.6 GB
GGUF
QW
Qwen2.5 32B AGI
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF

Other sizes

Keep browsing