Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
PL
lilloukas_platypus-30b
Platypus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 26B A4B StyleTune V2 QAT
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
Vision
OL
Olmo 3 Think AIO
OLMo · prithivMLmods
Params32.2B
Context64K
Q4_K_M4.5 GB
Reasoning
ST
dolphincoder starcoder2 15b
StarCoder · dagbs
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
XI
Xing4.0 29B A4B CRACK
Xing · dealignai
Params31.2B
Context256K
Q4_K_M19.0 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
Devstral Small 2505
Mistral · mistralai
Params23.6B
Context128K
Smallest13.4 GB
Coding
BO
Boogu Image Turbo GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
GGUF
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SU
SuperGemma 4 12b Abliterated
Supergemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B i1
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
ReasoningTool use
IN
Inkbot 13B 8k 0.2
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BO
Bonsai 2 27b VL Uncensored PTQ1 PTQ2 MTP
Bonsai · W-Zil
Params27B
Context256K
Smallest5.9 GB
Vision
MI
Mistral Small Instruct 2409
Mistral · DavidAU
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
QW
Dotnet Coder 14b Merged
Qwen · zipaltrivedi
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
SC
Scarlet Shadow 31B
Scarlet · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
RoleplayVision
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NI
Q3 Nilcall 32B v0.1
Nilcall · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningRoleplayTool use
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding

Other sizes

Keep browsing