Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
TE
Tenebra_30B_Alpha01_FP16
Tenebra · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
GE
Gemma 4 12B
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
GE
Gemma 4 Vain 26B A4B
Gemma · Ozili
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
SA
Sakura SOLAR Instruct
Sakura · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Artemis 31B v1.1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwenseek 3.8 27B CyberLite BF16
Qwen · trjxter
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · DavidAU
Params16.5B
Context8K
Q4_K_M10.0 GB
LL
Llama3Ternary 10b
Llama · CMSManhattan
Params9.64B
Context8K
Smallest4.3 GB
AT
Athnete 13B
Athnete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
WI
WizardCoder Python 13B V1.0 i1
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CH
Chocolatine 14B Instruct DPO v1.2 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
TI
TimeCrystal L2 13B
Timecrystal · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 27B Finance
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OR
Ornith 1.5 27B A3B CoderX MTP
Ornith · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · ArliAI
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
TO
tokyotech llm Swallow 13b instruct v0.1
Tokyotech · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 27B Velocity
Qwen · joycx
Params27.3B
Context—
Smallest0.0 GB
QW
Qwen2.5 32b RP Ink
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
OR
Orion-14B-Chat-0126-ck19800
Orion · OrionStarAI
Params14.5B
Context4K
Smallest29.0 GB