Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
Reasoning
QW
Qwen3.8 27B Cold Fusion GAIN Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GP
GPT OSS 20B Uncensored HauhauCS Balanced
gpt-oss · HauhauCS
Params20.9B
Context128K
Smallest12.1 GB
GGUF
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
FE
Fenrir X 26B A4B
Fenrir · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3.8 27B NVFP4 Src
Qwen · LibertAIDAI
Params27B
Context256K
Q4_K_M15.8 GB
Vision
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
VI
Viking-33B
Viking · mradermacher
Params33B
Context4K
Q4_K_M20.0 GB
Coding
HU
humanizer-12b
Humanizer · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
QW
Qwen2.5 VL 32B Geometry
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
UnifiedReward Edit Qwen35 27b
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
Coding
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
AI
airoboros l2 13b gpt4 2.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
ReasoningTool use
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwen3.8 27B Uncensored noMTP Q4 K M OpenCode
Qwen · oceanonline
Params27B
Context256K
Q4_K_M16.5 GB
Tool use
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
Roleplay
AI
jondurbin_airoboros-c34b-3.1.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Vision
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
IN
InternVL3_5 38B
Internvl · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingVision
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · LxBarn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision

Other sizes

Keep browsing