Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Industry Coder 27B v1.0 BF16
Industry · kataguru
Params26.9B
Context256K
Q4_K_M2.0 GB
CodingReasoningTool use
GO
Goetia 26B A4B v1.5
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
B3
B3 27B i1
mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B i1
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
ST
State of the MoE RP 3x7b
State · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
Roleplay
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
Coding
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
DA
Darwin 27B RSI
Darwin · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
AC
Acolyte 22B i1
Acolyte · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
SA
Sarvamai.Sarvam 30b
Sarvam · DevQuasar
Params32.2B
Context128K
Smallest12.2 GB
GGUF
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
FR
Free Sydney V2 13B
Free · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 11B Instruct v0.1
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
GR
granite 34b code instruct
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
KN
Knight Miqu 27B MoE
Knight · mradermacher
Params27.9B
Context32K
Q4_K_M16.8 GB
GGUF
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
PS
PsyMedLewdReMM Inverted 20B i1
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
OX
oxy 1 small i1
Oxy · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
SA
Sanad 1.0
Sanad · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
QW
Swift Qwen3.8 27B Uncensored MTP Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
QW
Qwen3.8 27B LowGPU uncensored NoMTP IQ3XXXS
Qwen · TheWegemann
Params27B
Context256K
Smallest9.6 GB
ReasoningVision
QW
Qwen3.5 27B RpRMax v1
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
Vision
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · Milad4545
Params27.3B
Context256K
Smallest3.2 GB
CodingReasoningTool use
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
EV
EverythingLM 13b V2 16K
Everythinglm · TheBloke
Params13B
Context—
Q4_K_M6.3 GB
GGUF

Other sizes

Keep browsing