Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
GP
Openai_Gpt Oss 20b
gpt-oss · lmstudio-community
Params20.9B
Context128K
Smallest12.1 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · orcarouter
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 4 12b It Uncensored
Gemma · zaakirio
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
WA
LiveAvatar
Wan · audio-cpp
Params16.3B
Context—
Smallest0.3 GB
GGUF
UN
Underdog Saluki 27B 1.0 MTP Abliterated
Underdog · Kujira
Params27.3B
Context256K
Smallest8.3 GB
Tool use
QW
Swift 1.5 Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params28B
Context256K
Smallest8.8 GB
Vision
MI
Cydonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
gemma 4 12b heretic abliterated
Gemma · culturerevolt
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
KR
Krea 2 Turbo
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Q4_K_M16.6 GB
ReasoningRoleplayTool use
MI
MiniMax H3
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
GGUF
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Q4_K_M8.1 GB
GGUF
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Q4_K_M19.1 GB
Vision
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
HE
Hermes 4 14B
Hermes · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
MU
Homura 30B
Muse · hyrelabs
Params28B
Context128K
Q4_K_M16.9 GB
Tool use
GR
grug 27b qat q4
Grug · ProCreations
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
LT
LTX 2.5 uncensored v1.1 FP8
Ltx · ChrisColeTech
Params21B
Context—
Q4_K_M7.5 GB
GGUF
GE
Gemma 4 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
NA
Nanbeige4.3 33B
Nanbeige · bartowski
Params33.1B
Context512K
Q4_K_M20.8 GB
ReasoningTool use
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Google_Gemma 4 31B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params30.7B
Context256K
Smallest17.7 GB
Vision
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision

Other sizes

Keep browsing