Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
CodeLlama 34b Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
GodziLLa 30B i1
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
HE
HelpingAI-15B
Helpingai · mradermacher
Params15.3B
Context4K
Q4_K_M9.3 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
CodingEmbeddingReasoning
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
LT
LTX2.3 10Eros 1.4
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
ReasoningVision
QW
Qwen3.6 27B PRISM PRO
Qwen · Ex0bit
Params27.3B
Context256K
Smallest13.7 GB
GGUF
MU
Muse Glimmer 30B NVFP4
Muse · esatapedico
Params27.9B
Context128K
Smallest15.2 GB
Vision
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
WI
WizardCoder 33B V1.1
Wizardcoder · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
MI
Dolphin3.0 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
QW
Qwen3.8 27B full Uncensored
Qwen · 0xSojalSec
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B TURBO MTP
Qwen · nimbowz
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
NE
NeuralStar_FusionWriter_4x7b
Neuralstar · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
RP
RPBizkit v11 12B Base
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · evansanih
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
LI
LingBot 30B 3B GGUF ComfyUI
Lingbot · realrebelai
Params30B
Context—
Q4_K_M17.0 GB
GGUF
WI
WizardCoder Python 34B V1.0 i1
Wizardcoder · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Other sizes

Keep browsing