Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3 32B Abliterated
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
NS
NSFW_13B_sft
Nsfw · mzwing
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
LF
LFM2.5 24B A2B Uncensored
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
MI
Devstral Small 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
FR
Frostwind 10.7B v1
Frostwind · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
general models
General · Chroma111
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Qwen3.6 27B uncensored abliterated i1 IQ4 XS GGUF Smaller
Qwen · lemonyins
Params27B
Context—
Smallest0.0 GB
GGUF
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
QW
Replete LLM V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
ThinkingCap Qwen3.8 27B abliterated
Qwen · IstroSec
Params27.3B
Context256K
Q4_K_M17.0 GB
ReasoningVision
QW
Qwen2.5 Coder 14B E2E Tests
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · ScottzillaSystems
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
GO
Godoter
Godoter · Ruler97
Params27B
Context256K
Q4_K_M16.5 GB
Coding
QW
RavenXAiLabs Chaos Agent Qwen3.8 27B Frontier Intelligence Injected OBLITERATED
Qwen · deadbydawn101
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
CodingVision
VE
VeriLoop E2 GSQ RCO
Veriloop · tahaalam2009
Params27B
Context256K
Smallest8.5 GB
CodingVision
LM
LMCocktail 10.7B v1
Lmcocktail · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DE
gemma 4 12B IT QAT Q4 K M DeepSeek distill
DeepSeek · gwejgteheg
Params11.9B
Context256K
Smallest7.4 GB
Vision
DA
Dark Scarlett v1.0 26B A4B
Dark · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
VI
Vigogne 2 13B Instruct
Vigogne · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MY
MythoMix L2 13B
Mythomix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
Glistening Gem 31B v2.1
Glistening · kin2341
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GE
medgap gemma 4 12b
Gemma · protocolsyncllc
Params11.9B
Context256K
Smallest0.5 GB
ReasoningTool useVision
XO
XORTRON AgentRICO
Xortron · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
GL
MuXodious GLM 4.7 Flash absolute heresy APEX
GLM · Koshkasa
Params30B
Context198K
Q4_K_M19.1 GB
Roleplay

Other sizes

Keep browsing