Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningRoleplay
TE
Tenebra_30B_Alpha01_FP16
Tenebra · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 12B
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool use
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
GE
Gemma 4 Vain 26B A4B
Gemma · Ozili
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
CodingRoleplay
SA
Sakura SOLAR Instruct
Sakura · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
Artemis 31B v1.1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwenseek 3.8 27B CyberLite BF16
Qwen · trjxter
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
Reasoning
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · DavidAU
Params16.5B
Context8K
Q4_K_M10.0 GB
Roleplay
LL
Llama3Ternary 10b
Llama · CMSManhattan
Params9.64B
Context8K
Smallest4.3 GB
GGUF
AT
Athnete 13B
Athnete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
WI
WizardCoder Python 13B V1.0 i1
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
CH
Chocolatine 14B Instruct DPO v1.2 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
TI
TimeCrystal L2 13B
Timecrystal · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
QW
Qwen3.8 27B Finance
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
OR
Ornith 1.5 27B A3B CoderX MTP
Ornith · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
CodingVision
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · ArliAI
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
Vision
TO
tokyotech llm Swallow 13b instruct v0.1
Tokyotech · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 27B Velocity
Qwen · joycx
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 32b RP Ink
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Roleplay
OR
Orion-14B-Chat-0126-ck19800
Orion · OrionStarAI
Params14.5B
Context4K
Smallest29.0 GB
Coding

Other sizes

Keep browsing