Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
XI
Xing4.0 29B A4B
Xing · XingChen-AGI
Params31.2B
Context256K
Smallest0.2 GB
GGUF
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
RoleplayVision
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
WI
ehartford_wizard-vicuna-13b-uncensored
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ Uncensored
DeepSeek · IndrasMirror
Params14.7B
Context—
Smallest5.7 GB
GGUF
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
Roleplay
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
Tool useVision
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
ST
StartLux Decision v1 27B Q4 K M
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8-27B
Qwen · julianmb
Params27.3B
Context256K
Smallest9.2 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated PQ2 0 MTP
Ternary · BoldingBuilds
Params27B
Context256K
Smallest7.2 GB
GGUF
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
SC
SCAIL 2 GGUF ComfyUI
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen3.8-27B-Uncensored-Aggressive
Qwen · 0xKitkat
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B Uncensored IQ4 XS MTP 16GB VRAM
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
GGUF
QW
Qwen3 VL 30B A3B Instruct
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen2.5 14B_Uncencored
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
MI
MiniMax H3 comfyUI
Minimax · vantagewithai
Params33.1B
Context—
Q4_K_M19.9 GB
GGUF
GL
Glm-4-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
IN
Ingot I 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
TI
Tifa DeepsexV3 14b GGUF Q6
Tifa · ValueFX9507
Params14.8B
Context32K
Smallest12.1 GB
Roleplay
QW
Qwen3.6 VL REAP 26B A3B
Qwen · keithnull
Params26.6B
Context256K
Q4_K_M16.3 GB
ReasoningTool useVision
GE
gemma 4 31B it
Gemma · AtomicChat
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
BI
Bielik-11B-v3.0-Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF

Other sizes

Keep browsing