Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
Openhands Lm 32b v0.1
Openhands · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3 coder REAP 25B A3B Rust
Qwen · Em-80
Params25B
Context256K
Q4_K_M15.1 GB
Coding
LL
DeepHermes 3 Llama 3 8B Preview
Llama · mradermacher
Params16.5B
Context128K
Q4_K_M10.0 GB
ReasoningTool use
TA
tastysin2
Tastysin · piefke123
Params14.3B
Context—
Smallest15.4 GB
GGUF
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
LL
CodeLlama 13B MORepair
Llama · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
WA
Wayfarer 2 12B
Wayfarer · LatitudeGames
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
Neuraljack 12B MoE
Neuraljack · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
KI
RP King 12b
King · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
GE
voxprint gemma4 31b
Gemma · Mitroshenkov87
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
DH
Dhanishtha 2.0 Preview
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
SK
Skywork Skywork R1V3 38B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
Vision
QW
Qwopus3.6 27B v2
Qwopus · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
SA
Salience 1.5 Flash
Salience · bartowski
Params30.5B
Context256K
Q4_K_M18.7 GB
CodingReasoningTool use
QW
Qwen3 VL 30B A3B Thinking
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
GE
Gemma-4-26B-A4B-It
Gemma · TaterTotterson
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · InferenceIllusionist
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
QW
Huihui Qwen3.8 27B Abliterated NVFP4
Qwen · renketong
Params27.3B
Context256K
Smallest19.7 GB
Vision
DA
L3 DARKEST PLANET 16.5B i1
Darkest · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
Roleplay
CY
Cyberdonia 24B v8
Cyberdonia · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
Roleplay
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Roleplay
DA
L3 Darker Planet 12.15B
Darker · DavidAU
Params12.2B
Context8K
Q4_K_M7.4 GB
Roleplay
ME
MedGo
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 Nemotron 32B RLBFF
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GE
Gemma4 31b Opus Reasoning v5
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF

Other sizes

Keep browsing