Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
AQ
Aquif 3 Moe 17b A2.8B
Aquif · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
PH
Phi4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
SO
SOCAM V1
Socam · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
BI
Bielik 11B v2.3 Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB
ST
starcoder2-15b
StarCoder · second-state
Params16B
Context16K
Q4_K_M9.9 GB
GE
Gemma 4 12B Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
WI
Wicked Stuff 26B A4B Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
WI
WizardCoder Python 13B V1.0
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
QR
Qra 13B chat i1
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SA
vagosolutions_sauerkrautlm-solar-instruct
Sauerkrautlm · TheBloke
Params10.7B
Context8K
Q4_K_M6.5 GB
RO
Rose 20B
Rose · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
FI
Fimbulvetr 11B v2 iMat
Fimbulvetr · InferenceIllusionist
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
Chocolatine 14B Instruct DPO v1.1 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · lmstudio-community
Params31.6B
Context1024K
Q4_K_M24.5 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Continuum
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.6 27B redteam v5
Qwen · RedTeamLab
Params27B
Context256K
Q4_K_M2.0 GB
CO
oobabooga_codebooga-34b-v0.1
Codebooga · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
MY
MythoMax L2 13b
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
GE
Gemma 4 26B A4B Heretic Stable
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
CO
ConfigurableBeagle-11B
Configurablebeagle · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
OR
ddh0_orcamaid-v2-fix-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
QW
Qwen3.8-27B
Qwen · BoldingBuilds
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Humberto16
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 30B A1.5B 64K High Speed NEO Imatrix MAX
Qwen · DavidAU
Params30.5B
Context64K
Q4_K_M18.6 GB
SO
Solstice-11B-v1
Solstice · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB