Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MA
Mammoth 1
Mammoth · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
NO
North Mini Code 1.0
North · mradermacher
Params30.5B
Context488K
Q4_K_M18.6 GB
CodingReasoningTool use
MA
Marconi v1 3x7B 10B MoE
Marconi · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Tool use
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
RoleplayVision
FI
Fimbulvetr-11B-v2
Fimbulvetr · backyardai
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
Camel Platypus2 13B
Camel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NI
Nightshade-Violet-12B
Nightshade · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen Qwen3.8 27B GGUF IQ2 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · ItDelta
Params27.3B
Context256K
Smallest3.2 GB
CodingReasoningTool use
GE
Gemma 2 27b It Abliterated
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.8-27B-Palimpsest-v1
Qwen · xero0000
Params27.3B
Context256K
Q4_K_M16.5 GB
Tool use
AE
aegolius acadicus v1 30b i1
Aegolius · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
GE
Gemma4 12B Uncensored HauhauCS 1M
Gemma · satgeze
Params11.9B
Context256K
Smallest0.3 GB
Vision
QW
Qwen3 14B Gemini 3 Pro Preview High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · divpasta123
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GP
gpt astra 7 undecillion 7u5go5
Gpt · oroboros-labs
Params27.3B
Context—
Smallest0.9 GB
GGUF
FL
flux.1 dev modern anime full
Flux · alfredplpl
Params11.9B
Context—
Smallest6.8 GB
GGUF
SN
Snowpiercer 15B v3
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
MI
Mistral Nemo NT Ko 12B sft i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
WA
wan22EnhancedNSFWCameraPrompt nsfwFASTMOVEV2Q6KH
Wan · Ricoletto1
Params14.3B
Context—
Smallest12.0 GB
GGUF
TA
TableLLM 13b
Tablellm · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
CodingReasoning
GR
Granite 20b Code Base 8k
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
Coding
CA
Captain Eris Violet V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CO
C4Ai Command R 08 2024
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
GE
Gemma-4-12B-Unified-System-One
Gemma · knowlet
Params11.9B
Context256K
Smallest12.7 GB
Vision
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use

Other sizes

Keep browsing