Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AQ
Aquif 3 Moe 17b A2.8B
Aquif · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
CodingReasoning
PH
Phi4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
SO
SOCAM V1
Socam · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
ST
starcoder2-15b
StarCoder · second-state
Params16B
Context16K
Q4_K_M9.9 GB
Coding
GE
Gemma 4 12B Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
WI
Wicked Stuff 26B A4B Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
ReasoningRoleplayTool use
WI
WizardCoder Python 13B V1.0
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QR
Qra 13B chat i1
Qra · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
vagosolutions_sauerkrautlm-solar-instruct
Sauerkrautlm · TheBloke
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
RO
Rose 20B
Rose · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
FI
Fimbulvetr 11B v2 iMat
Fimbulvetr · InferenceIllusionist
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Chocolatine 14B Instruct DPO v1.1 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · lmstudio-community
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Continuum
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplay
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen3.6 27B redteam v5
Qwen · RedTeamLab
Params27B
Context256K
Q4_K_M2.0 GB
GGUF
CO
oobabooga_codebooga-34b-v0.1
Codebooga · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
MY
MythoMax L2 13b
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama3-18B-lingyang-v1
Llama · mradermacher
Params18.1B
Context1024K
Q4_K_M10.9 GB
GGUF
GE
Gemma 4 26B A4B Heretic Stable
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
OP
OpenResearcher 30B A3B
Openresearcher · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
CO
ConfigurableBeagle-11B
Configurablebeagle · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
OR
ddh0_orcamaid-v2-fix-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · BoldingBuilds
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Humberto16
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3 30B A1.5B 64K High Speed NEO Imatrix MAX
Qwen · DavidAU
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
SO
Solstice-11B-v1
Solstice · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Other sizes

Keep browsing