Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B UNCENSORED
Qwen · dealignai
Params27.3B
Context256K
Q4_K_M17.0 GB
LT
LTXV 13B 0.9.8 distilled
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
QW
Qwen3.6 27B Heretic Uncensored FINETUNE NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.9 GB
NE
NemoMix Unleashed 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MU
Muse Glimmer 30B Heretic Uncensored
Muse · 0bserverx
Params28B
Context128K
Q4_K_M16.9 GB
FL
flux.1 dev abliterated V2
Flux · t8star
Params11.9B
Context—
Q4_K_M6.9 GB
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
FL
FLUX.1 schnell
Flux · leejet
Params11.9B
Context—
Smallest4.1 GB
TR
Models Arcee Ai Trinity Mini
Trinity · MaziyarPanahi
Params26B
Context128K
Q4_K_M15.8 GB
WA
Wan2.2 Fun A14B Control Camera
Wan · QuantStack
Params14.8B
Context—
Q4_K_M10.7 GB
MI
Models Mistralai Ministral 3 14B Reasoning 2512
Mistral · MaziyarPanahi
Params13.5B
Context256K
Q4_K_M8.2 GB
NE
Models Nvidia NVIDIA Nemotron Nano 12B v2
Nemotron · MaziyarPanahi
Params12.3B
Context1024K
Q4_K_M7.5 GB
GE
gemma 4 26B A4B it uncensored
Gemma · TrevorJS
Params25.2B
Context256K
Q4_K_M16.8 GB
TE
Swift Bonsai 2
Ternary · ukisai
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3.8 27B Pi
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
WI
Wicked Tutu 31B v0.1
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B abliterated cyber preview MTP
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Sakura MiniMax H3
Minimax · webmp3
Params20.1B
Context—
Q4_K_M12.6 GB
WA
Wan2.2 Fun A14B Control
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
TE
Offrail 27B Uncensored
Ternary · sudoingx
Params28.6B
Context256K
Smallest6.3 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 27B GSQ RCO IQ3 XXS Uncensored
Qwen · RentedNoodle
Params27.3B
Context256K
Smallest10.4 GB
CE
MN 12B Celeste V1.9
Celeste · nothingiisreal
Params12.2B
Context1000K
Q4_K_M7.5 GB
JE
JEV 27B VL
Jev · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek V4.1 Flash 1017 XQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB