Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
AR
Artemis 31B v1.2
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
QW
Qwen3-VL-32B Instruct MiniMax-H3 L0-49 Q4_K_M
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
LT
LTX 2.3
Ltx · QuantStack
Params21B
Context—
Q4_K_M17.8 GB
QW
Qwen3-32B
Qwen · unsloth
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.8 27B pi
Qwen · bytkim
Params27B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
QW
Qwen3.5 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.8 27B ABLITERATED BF16
Qwen · Blackfrost-AI
Params27.3B
Context256K
Q4_K_M16.8 GB
WH
WhiteRabbitNeo-33B-v1.5
Whiterabbitneo · manuelgutierrez
Params33.3B
Context16K
Q4_K_M19.9 GB
UN
Underdog Saluki 27B 1.0 MTP
Underdog · Kujira
Params27.3B
Context256K
Smallest8.3 GB
QW
qwen image edit uncensored
Qwen · ChrisColeTech
Params20.4B
Context—
Q4_K_M11.7 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.5 GB
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
TE
Ternary Bonsai 2 27B Uncensored Heretic v2
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
QW
Qwen 3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Heretic GSQ RCO
Qwen · 0bserverx
Params27B
Context256K
Smallest8.4 GB
LT
LTX 2.5 Distilled
Ltx · Abiray
Params21B
Context—
Q4_K_M15.7 GB
QW
Qwen_Qwen3.6 27B
Qwen · lmstudio-community
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 27B OrcaRouter GSQ RCO IQ3 XXS Uncensored
Qwen · RentedNoodle
Params27.3B
Context256K
Smallest10.4 GB
WA
Wan Animate 2 GGUFs
Wan · realrebelai
Params16.4B
Context—
Q4_K_M11.3 GB
CY
Cydonia 24B v4.3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
TR
Translategemma 12b It
Translategemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
FL
FLUX.1 schnell
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
MI
Sakura MiniMax H3 Uncensored
Minimax · webmp3
Params25.8B
Context—
Q4_K_M15.1 GB
QW
Qwen3.8 27B Uncensored OrcaRouter
Qwen · chimingw
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB