Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
PL
lilloukas_platypus-30b
Platypus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GE
Gemma 4 26B A4B StyleTune V2 QAT
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
OL
Olmo 3 Think AIO
OLMo · prithivMLmods
Params32.2B
Context64K
Q4_K_M4.5 GB
ST
dolphincoder starcoder2 15b
StarCoder · dagbs
Params16B
Context16K
Q4_K_M9.9 GB
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
XI
Xing4.0 29B A4B CRACK
Xing · dealignai
Params31.2B
Context256K
Q4_K_M19.0 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Devstral Small 2505
Mistral · mistralai
Params23.6B
Context128K
Smallest13.4 GB
BO
Boogu Image Turbo GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SU
SuperGemma 4 12b Abliterated
Supergemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B i1
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
IN
Inkbot 13B 8k 0.2
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
BO
Bonsai 2 27b VL Uncensored PTQ1 PTQ2 MTP
Bonsai · W-Zil
Params27B
Context256K
Smallest5.9 GB
MI
Mistral Small Instruct 2409
Mistral · DavidAU
Params22.2B
Context128K
Q4_K_M13.3 GB
QW
Dotnet Coder 14b Merged
Qwen · zipaltrivedi
Params14.8B
Context32K
Q4_K_M9.0 GB
SC
Scarlet Shadow 31B
Scarlet · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
NI
Q3 Nilcall 32B v0.1
Nilcall · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB