Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Huihui gemma 4 12B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
Vision
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen Image
Qwen · city96
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
NA
Nanbeige4.3-33B
Nanbeige · AtomicChat
Params33.1B
Context512K
Q4_K_M21.2 GB
ReasoningTool use
TE
Hy MT2 30B A3B
Tencent · tencent
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · unsloth
Params32.9B
Context1024K
Q4_K_M25.3 GB
GGUF
QW
Qwen3-30B-A3B
Qwen · unsloth
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
SO
Models Upstage Solar Pro Preview Instruct
Solar · MaziyarPanahi
Params22B
Context4K
Q4_K_M13.3 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M39.7 GB
Coding
FL
FLUX.1 dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
CL
Cloudflare clef
Clef · bartowski
Params27B
Context256K
Q4_K_M17.7 GB
CodingVision
BE
BeaverAI NeMoist 21B v1a
Beaverai · RichardErkhov
Params21B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
MI
mistralai_Devstral Small 2 24B Instruct 2512
Mistral · lmstudio-community
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
MI
Models Mrfakename Mistral Small 3.1 24b Instruct 2503 Hf
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LT
LTX 2
Ltx · unsloth
Params18.9B
Context—
Q4_K_M12.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
Models Google Gemma 3 12b It
Gemma · MaziyarPanahi
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
Models Mistralai Mistral Nemo Instruct 2407
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TP
tpn004 cand v3f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
GGUF
TP
tpn004 cand v4f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
GGUF
MI
Rocinante X 12B v1
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TP
tpn004 cand v3f l1im
Tpn · tatjr13
Params23.6B
Context128K
Smallest18.3 GB
GGUF
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 VL 32B Instruct ultra uncensored heretic H3
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
Vision
TP
tpn004 cand v4f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
GGUF
TP
tpn004 cand v1f aim
Tpn · tatjr13
Params23.6B
Context128K
Smallest14.7 GB
GGUF
MI
MiniMax H3 encoder
Minimax · joeygambino
Params32.8B
Context256K
Q4_K_M19.8 GB
CodingVision
OR
Orion 26B A4B v1.1
Orion · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
Vision

Other sizes

Keep browsing