Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.6 27B Abliterated
Qwen · huihui-ai
Params27.3B
Context256K
Smallest10.9 GB
Vision
AR
Artemis 31B v1.2
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
Vision
QW
Qwen3-VL-32B Instruct MiniMax-H3 L0-49 Q4_K_M
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
Vision
LT
LTX 2.3
Ltx · QuantStack
Params21B
Context—
Q4_K_M17.8 GB
GGUF
QW
Qwen3-32B
Qwen · unsloth
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3.8 27B pi
Qwen · bytkim
Params27B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
ReasoningTool use
QW
Qwen3.5 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
Vision
QW
Qwen3.8 27B ABLITERATED BF16
Qwen · Blackfrost-AI
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
WH
WhiteRabbitNeo-33B-v1.5
Whiterabbitneo · manuelgutierrez
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
UN
Underdog Saluki 27B 1.0 MTP
Underdog · Kujira
Params27.3B
Context256K
Smallest8.3 GB
Tool use
QW
qwen image edit uncensored
Qwen · ChrisColeTech
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningRoleplay
AN
anthracite org magnum 12b v2
Anthracite · RichardErkhov
Params12.2B
Context—
Q4_K_M0.0 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
TE
Ternary Bonsai 2 27B Uncensored Heretic v2
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
Vision
QW
Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
Vision
QW
Qwen 3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B Heretic GSQ RCO
Qwen · 0bserverx
Params27B
Context256K
Smallest8.4 GB
GGUF
LT
LTX 2.5 Distilled
Ltx · Abiray
Params21B
Context—
Q4_K_M15.7 GB
GGUF
QW
Qwen_Qwen3.6 27B
Qwen · lmstudio-community
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 Coder 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
Qwen3.8 27B OrcaRouter GSQ RCO IQ3 XXS Uncensored
Qwen · RentedNoodle
Params27.3B
Context256K
Smallest10.4 GB
Tool useVision
WA
Wan Animate 2 GGUFs
Wan · realrebelai
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
CY
Cydonia 24B v4.3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
TR
Translategemma 12b It
Translategemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
FL
FLUX.1 schnell
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
MI
Sakura MiniMax H3 Uncensored
Minimax · webmp3
Params25.8B
Context—
Q4_K_M15.1 GB
GGUF
QW
Qwen3.8 27B Uncensored OrcaRouter
Qwen · chimingw
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision

Other sizes

Keep browsing