Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B UNCENSORED
Qwen · dealignai
Params27.3B
Context256K
Q4_K_M17.0 GB
ReasoningVision
LT
LTXV 13B 0.9.8 distilled
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
GGUF
QW
Qwen3.6 27B Heretic Uncensored FINETUNE NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.9 GB
CodingReasoningRoleplay
NE
NemoMix Unleashed 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MU
Muse Glimmer 30B Heretic Uncensored
Muse · 0bserverx
Params28B
Context128K
Q4_K_M16.9 GB
Vision
FL
flux.1 dev abliterated V2
Flux · t8star
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
FL
FLUX.1 schnell
Flux · leejet
Params11.9B
Context—
Smallest4.1 GB
GGUF
TR
Models Arcee Ai Trinity Mini
Trinity · MaziyarPanahi
Params26B
Context128K
Q4_K_M15.8 GB
GGUF
WA
Wan2.2 Fun A14B Control Camera
Wan · QuantStack
Params14.8B
Context—
Q4_K_M10.7 GB
GGUF
MI
Models Mistralai Ministral 3 14B Reasoning 2512
Mistral · MaziyarPanahi
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
NE
Models Nvidia NVIDIA Nemotron Nano 12B v2
Nemotron · MaziyarPanahi
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
GE
gemma 4 26B A4B it uncensored
Gemma · TrevorJS
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
TE
Swift Bonsai 2
Ternary · ukisai
Params27B
Context256K
Smallest5.9 GB
Reasoning
QW
Qwen3.8 27B Pi
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
CodingReasoningTool use
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
CodingVision
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
GGUF
WI
Wicked Tutu 31B v0.1
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Qwen3.8 27B abliterated cyber preview MTP
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
MI
Sakura MiniMax H3
Minimax · webmp3
Params20.1B
Context—
Q4_K_M12.6 GB
GGUF
WA
Wan2.2 Fun A14B Control
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
TE
Offrail 27B Uncensored
Ternary · sudoingx
Params28.6B
Context256K
Smallest6.3 GB
GGUF
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
QW
Qwen3.8 27B GSQ RCO IQ3 XXS Uncensored
Qwen · RentedNoodle
Params27.3B
Context256K
Smallest10.4 GB
Tool useVision
CE
MN 12B Celeste V1.9
Celeste · nothingiisreal
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
JE
JEV 27B VL
Jev · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
Vision
DE
DeepSeek V4.1 Flash 1017 XQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GGUF

Other sizes

Keep browsing