Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
GPT OSS 20B Uncensored HauhauCS Aggressive
gpt-oss · HauhauCS
Params20.9B
Context128K
Smallest12.1 GB
GGUF
QW
Qwen3.8 27B Coder390 EfficientThink abliterated ROCmFPX
Qwen · ArtomYuan
Params27.3B
Context256K
Smallest14.6 GB
CodingVision
KU
Kr3a
Kutches · Kutches
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Swift-1.5-Qwen3.8-27B-Uncensored-MTP
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
ReasoningTool useVision
OP
openjev
Openjev · openjev
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
PH
phi 4
Phi · lmstudio-community
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
MI
Rocinante XL 16B v1
Mistral · TheDrummer
Params16.1B
Context128K
Q4_K_M9.7 GB
GGUF
AE
AesCode 32B
Aescode · bartowski
Params32.8B
Context256K
Q4_K_M20.5 GB
CodingVision
DA
Darwin 27B RSI
Darwin · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Reasoning
GE
Gemma 3 27b It
Gemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SE
Sexpedition MS3.2 24B
Sexpedition · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.8 27B Abliterated MTP
Qwen · GCSA-AiLab
Params27B
Context256K
Q4_K_M16.5 GB
Vision
DE
deepseek-ai_deepseek-coder-33b-base
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored
Qwen · AtomicChat
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
WA
Wan2.1BasedModels
Wan · Isi99999
Params17.3B
Context—
Q4_K_M10.1 GB
GGUF
MI
dolphin 2.9.3 mistral nemo 12b
Mistral · dphn
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingTool use
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
QW
Qwopus GLM 18B Merged
Qwen · KyleHessling1
Params15.9B
Context256K
Q4_K_M9.8 GB
ReasoningTool use
JE
JEV 27B VL Uncensored
Jev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
HE
Hemmingway 1 Abliterated Extreme
Hemmingway · JohnDi
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
PU
PuddleJumper 13B
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
IN
Index Anisora V3.2
Index · youcef079
Params14.3B
Context—
Q4_K_M10.1 GB
GGUF
MI
devstral-small-2507
Mistral · mistralai
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
QW
qwen image edit plus
Qwen · calcuis
Params14.3B
Context—
Q4_K_M11.7 GB
GGUF
LL
codellama_codellama-34b-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
Gemma4 12B IT Abliterated
Gemma · DuoNeural
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF

Other sizes

Keep browsing