Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Huihui gemma 4 12B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen Image
Qwen · city96
Params20.4B
Context—
Q4_K_M13.1 GB
NA
Nanbeige4.3-33B
Nanbeige · AtomicChat
Params33.1B
Context512K
Q4_K_M21.2 GB
TE
Hy MT2 30B A3B
Tencent · tencent
Params30B
Context256K
Q4_K_M18.2 GB
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · unsloth
Params32.9B
Context1024K
Q4_K_M25.3 GB
QW
Qwen3-30B-A3B
Qwen · unsloth
Params30.5B
Context40K
Q4_K_M18.6 GB
SO
Models Upstage Solar Pro Preview Instruct
Solar · MaziyarPanahi
Params22B
Context4K
Q4_K_M13.3 GB
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M39.7 GB
FL
FLUX.1 dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
CL
Cloudflare clef
Clef · bartowski
Params27B
Context256K
Q4_K_M17.7 GB
BE
BeaverAI NeMoist 21B v1a
Beaverai · RichardErkhov
Params21B
Context—
Q4_K_M0.0 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
mistralai_Devstral Small 2 24B Instruct 2512
Mistral · lmstudio-community
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Models Mrfakename Mistral Small 3.1 24b Instruct 2503 Hf
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
LT
LTX 2
Ltx · unsloth
Params18.9B
Context—
Q4_K_M12.8 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Models Google Gemma 3 12b It
Gemma · MaziyarPanahi
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Models Mistralai Mistral Nemo Instruct 2407
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Q4_K_M7.5 GB
TP
tpn004 cand v3f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
TP
tpn004 cand v4f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
MI
Rocinante X 12B v1
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
TP
tpn004 cand v3f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 VL 32B Instruct ultra uncensored heretic H3
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
TP
tpn004 cand v4f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
TP
tpn004 cand v1f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
MI
MiniMax H3 encoder
Minimax · joeygambino
Params32.8B
Context256K
Q4_K_M19.8 GB
OR
Orion 26B A4B v1.1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB