Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
QW
Qwen3.8 27B OBLITERATED22 AGENT
Qwen · shoukewei
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · mradermacher
Params15.7B
Context4K
Q4_K_M10.4 GB
Reasoning
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · TTPPCC121
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DA
datagemma rig 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ME
mera mix 4x7B i1
Mera · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
GP
Gpt Oss 20b Uncensored Heretic
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
BO
NbAiLab/borealis2-26b-a4b-preview
Borealis · NbAiLab
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
SA
Saltware-solar-10.7b-v1.0
Saltware · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.2 8X3B GATED MOE Horror Reasoning Dark Champion uncensored 18.4B IMAT
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.8 GB
ReasoningRoleplay
JE
Sakura Humanlike Chat 2.0 JEV AutoRound
Jev · webmp3
Params27.3B
Context256K
Smallest13.5 GB
Tool useVision
WA
Wan2.1 Fun 14B Control
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
QW
Ektome Qwen3 30B A3B PristinelyUncensored
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.5 24B A3B Claude Opus Gemini 3.1 Pro Reasoning Distilled Heretic
Qwen · mradermacher
Params24.5B
Context256K
Q4_K_M15.0 GB
Reasoning
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
RU
MN 12B Runeweaver RP RU
Runeweaver · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
TR
Trinity Mini
Trinity · bartowski
Params26B
Context128K
Q4_K_M15.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Qwen3.8 27B MindMeld OneJev1.6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
PY
Pygmalion 2 13B SuperCOT
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PO
Polaris VGA 27B Post1.0e
Polaris · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding

Other sizes

Keep browsing