Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B TRB Fbl Cld Fsn Hrtc Unc NEO CDER MTP
Qwen · razz1k
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · byteshape
Params30.5B
Context256K
Smallest10.2 GB
GGUF
VI
VibeWorlder 30B A3B
Vibeworlder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
UN
Uncensored Frank 13b
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EE
EEVE-Korean-10.8B-instruct-v4-sft
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
IO
IoGPT A1 Instruct i1
Iogpt · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
HE
Hemmingway 1
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
JO
JoyAI Echo
Joyai · realrebelai
Params12.2B
Context—
Q4_K_M15.7 GB
GGUF
ME
Mellum2.1 12B A2.5B Thinking MTP
Mellum · bartowski
Params12.6B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
MI
Luau Devstral 24B Instruct v0.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
LL
CodeLlama 13B Fireplace i1
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CodingTool use
LL
Llama 3.2 8X3B MOE Dark Champion Instruct Uncensored Abliterated 18.4B
Llama · mradermacher
Params18.4B
Context128K
Q4_K_M11.3 GB
GGUF
FI
Fimburs11V3
Fimburs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PA
MS3.2 PaintedFantasy Visage v3 34B
Paintedfantasy · bartowski
Params34B
Context128K
Q4_K_M20.7 GB
GGUF
GE
Gemma 4 12B It Guardpoint
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Reasoning
UT
UtevoLux 3.6 27B
Utevolux · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.5 18b A3B Reap Coding Heretic v0
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
GGUF
QW
Qwen2.5 14B Uncensored Instruct i1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AT
Athnete 13B
Athnete · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama3.1 MOE 4X8B Gated IQ Multi Tier Deep Reasoning 32B
Llama · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplayTool use
QW
Qwen3.6 27B A3B Coder
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
CodingVision
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
MU
Muse Glimmer 30B Uncensored Heretic
Muse · OS-Software
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
ER
Erk 32B
Erk · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 12B It Heretic_Decensored
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
ReasoningRoleplay

Other sizes

Keep browsing