Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GO
GodziLLa 30B i1
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Q4_K_M16.5 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LT
LTX2.3 10Eros 1.4
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
QW
Qwen3.6 27B PRISM PRO
Qwen · Ex0bit
Params27.3B
Context256K
Smallest13.7 GB
MU
Muse Glimmer 30B NVFP4
Muse · esatapedico
Params27.9B
Context128K
Smallest15.2 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
WI
WizardCoder 33B V1.1
Wizardcoder · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
MI
Dolphin3.0 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
QW
Qwen3.8 27B full Uncensored
Qwen · 0xSojalSec
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
QW
Qwen3.8 27B TURBO MTP
Qwen · nimbowz
Params27B
Context256K
Q4_K_M18.0 GB
NE
NeuralStar_FusionWriter_4x7b
Neuralstar · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
RP
RPBizkit v11 12B Base
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · evansanih
Params14.8B
Context32K
Q4_K_M9.0 GB
LI
LingBot 30B 3B GGUF ComfyUI
Lingbot · realrebelai
Params30B
Context—
Q4_K_M17.0 GB
WI
WizardCoder Python 34B V1.0 i1
Wizardcoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB