Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
RE
Reka Flash 3
Reka · bartowski
Params21B
Context32K
Q4_K_M13.6 GB
GGUF
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
GGUF
QW
Zhi Create Qwen3 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
VellumMini 0.1 Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
ThinkingCap Qwen3.6 27B Heretic
Qwen · egibson
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
EL
Elysium2.1-11b
Elysium · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
MS
MSM MS Cydrion 22B
Msm · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest9.6 GB
ReasoningTool use
GE
Gemma 3 12b It Vl HighIQ Polaris Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GP
gpt oss 20b abliterated
gpt-oss · wangzhang
Params21B
Context128K
Q4_K_M15.8 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
GE
Gemma 4 31B It Uncensored Heretic v2
Gemma · lactroiii
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool useVision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Cdimabusinessent
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
VE
Veritas 12B
Veritas · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
Vision
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
EQ
Equinox 31B
Equinox · LatitudeGames
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Swift 1.5 Qwen3.8 27b
Qwen · br1nz
Params27B
Context256K
Smallest10.9 GB
GGUF
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
QW
Rombos LLM V2.6 Qwen 14b
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 14B Heretic
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwopus GLM 18B Merged
Qwen · Jackrong
Params15.9B
Context256K
Q4_K_M9.8 GB
CodingReasoningTool use
CO
CodeV SVA 14B
Codev · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
ME
Melody1437 26B A4B
Melody · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
GL
GLM 4.7 Flash REAP 23B A3B absolute heresy
GLM · MuXodious
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
QW
Qwen3.5 27B uncensored heretic v1
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · Lucebox
Params14.2B
Context—
Smallest4.9 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Other sizes

Keep browsing