Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3-Vl-30B-A3B-Thinking
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
ST
Stellar Witch 12B Heretic
Stellar · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
SO
SOLAR 10.7B Instruct v1.0 uncensored
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
NA
NaNovel 27B
Nanovel · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Huihui Qwen3.8 27B Abliterated
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
IN
Ingot VIII 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GE
Gemma 3 12b It Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Wicked Stuff 31B Final
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemory-26B-A4B-bf16
Gemory · Abiray
Params25.2B
Context256K
Q4_K_M16.8 GB
MO
Moonlight 16B A3B Instruct
Moonlight · mmnga
Params16B
Context8K
Q4_K_M10.5 GB
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
TI
TildeOpen 30B Instruct LV
Tildeopen · mradermacher
Params30.7B
Context64K
Q4_K_M18.5 GB
QW
MiniMax H3 TextEncoder 16GB
Qwen · pottokao
Params25.8B
Context256K
Smallest12.6 GB
QW
qwen image edit
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
IN
Ingot III 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
SU
Sulphur 2 base
Sulphur · fairy322
Params21B
Context—
Q4_K_M14.3 GB
MI
FastVideo FastH3 Omni 8 Step V1 ComfyUI
Minimax · vantagewithai
Params22.1B
Context—
Q4_K_M13.7 GB
LT
LTX 2.5
Ltx · molbal
Params21B
Context—
Smallest12.5 GB
SU
Sugoi 14B Ultra
Sugoi · sugoitoolkit
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Uncensored Genesis MTP
Qwen · LuffyTheFox
Params27.3B
Context—
Smallest15.8 GB
GL
GLM Z1 32B 0414
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
QW
Sperma Aj Qwen3.8 27b
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SK
Sketch Cydonia 24B V1.3
Sketch · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MU
Muse Glimmer 30B
Muse · AaryanK
Params28B
Context128K
Q4_K_M15.9 GB
SL
Slimaki Tavern 24B v1.3
Slimaki · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB