Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen Image 2512
Qwen · byteshape
Params20.4B
Context—
Q4_K_M11.4 GB
IN
InternVL3_5 14B
Internvl · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
CY
Cydonia 24B v4.3 Heretic v4
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
MiniMax H3 Turbo
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
QW
Qwen3.8 27B Uncensored Heretic Native MTP Preserved NVFP4
Qwen · llmfan46
Params27.3B
Context256K
Smallest16.9 GB
LL
phind_phind-codellama-34b-python-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Huihui Qwen3.8 27B Abliterated
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
CH
ChemLLM 20B Chat SFT i1
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
QW
Qwen3Vl 30b A3B Thinking
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
WA
Wan2.1 T2V 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
LT
LTXV 13B 0.9.8 dev
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
UN
Uncensored Jordan 13B
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Minimax H3 WAN2GP
Minimax · FenomAI
Params25.8B
Context—
Q4_K_M14.6 GB
CH
Chronos Hermes 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 VL 32B Instruct Heretic
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
RA
Raon 1 mini preview
Raon · NANI-Nithin
Params28.8B
Context256K
Q4_K_M19.7 GB
IN
InternVL3_5 30B A3B
Internvl · bartowski
Params30.5B
Context40K
Q4_K_M18.6 GB
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
MI
Codestral-22B-v0.1
Mistral · lmstudio-community
Params22.2B
Context32K
Q4_K_M13.3 GB
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OL
Olmo 3.1 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB