Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Vl-30B-A3B-Thinking
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
ST
Stellar Witch 12B Heretic
Stellar · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0 uncensored
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NA
NaNovel 27B
Nanovel · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Huihui Qwen3.8 27B Abliterated
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
ReasoningTool useVision
IN
Ingot VIII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
QW
Qwen2.5 VL 32B Instruct
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
GE
Gemma 3 12b It Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Wicked Stuff 31B Final
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemory-26B-A4B-bf16
Gemory · Abiray
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
MO
Moonlight 16B A3B Instruct
Moonlight · mmnga
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
TI
TildeOpen 30B Instruct LV
Tildeopen · mradermacher
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
QW
MiniMax H3 TextEncoder 16GB
Qwen · pottokao
Params25.8B
Context256K
Smallest12.6 GB
CodingTool useVision
QW
qwen image edit
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
IN
Ingot III 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
SU
Sulphur 2 base
Sulphur · fairy322
Params21B
Context—
Q4_K_M14.3 GB
GGUF
MI
FastVideo FastH3 Omni 8 Step V1 ComfyUI
Minimax · vantagewithai
Params22.1B
Context—
Q4_K_M13.7 GB
GGUF
LT
LTX 2.5
Ltx · molbal
Params21B
Context—
Smallest12.5 GB
GGUF
SU
Sugoi 14B Ultra
Sugoi · sugoitoolkit
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B Uncensored Genesis MTP
Qwen · LuffyTheFox
Params27.3B
Context—
Smallest15.8 GB
GGUF
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
Coding
QW
Sperma Aj Qwen3.8 27b
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
SK
Sketch Cydonia 24B V1.3
Sketch · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MU
Muse Glimmer 30B
Muse · AaryanK
Params28B
Context128K
Q4_K_M15.9 GB
Vision
SL
Slimaki Tavern 24B v1.3
Slimaki · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplay
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Other sizes

Keep browsing