Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
XI
Xing4.0 29B A4B
Xing · XingChen-AGI
Params31.2B
Context256K
Smallest0.2 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
WI
ehartford_wizard-vicuna-13b-uncensored
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
ST
StartLux Decision v1 27B Q4 K M
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · julianmb
Params27.3B
Context256K
Smallest9.2 GB
TE
Ternary Bonsai 2 27B Abliterated PQ2 0 MTP
Ternary · BoldingBuilds
Params27B
Context256K
Smallest7.2 GB
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
SC
SCAIL 2 GGUF ComfyUI
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.5 GB
QW
Qwen3.8-27B-Uncensored-Aggressive
Qwen · 0xKitkat
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored IQ4 XS MTP 16GB VRAM
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen2.5 14B_Uncencored
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
MiniMax H3 comfyUI
Minimax · vantagewithai
Params33.1B
Context—
Q4_K_M19.9 GB
GL
Glm-4-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
IN
Ingot I 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
TI
Tifa DeepsexV3 14b GGUF Q6
Tifa · ValueFX9507
Params14.8B
Context32K
Smallest12.1 GB
QW
Qwen3.6 VL REAP 26B A3B
Qwen · keithnull
Params26.6B
Context256K
Q4_K_M16.3 GB
GE
gemma 4 31B it
Gemma · AtomicChat
Params30.7B
Context256K
Q4_K_M18.7 GB
BI
Bielik-11B-v3.0-Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB