Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
BR
Broken Tutu 24B Transgression v2.0
Broken · Naofan
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
QW
Qwen2.5 14B Instruct
Qwen · legraphista
Params14.8B
Context32K
Smallest3.6 GB
GGUF
QW
Qwen3 VL 32B Ultra Heretic Minimax H3
Qwen · eraiko
Params25.2B
Context256K
Smallest17.8 GB
Vision
BO
Bookworm 10.7B v0.4 DPO
Bookworm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
GP
GPT4 X Alpasta 30b
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
Qwen3 VL 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
GI
GigaChat 20B A3B instruct v1.5
Gigachat · ai-sage
Params20.6B
Context128K
Q4_K_M12.5 GB
GGUF
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Huihui Qwen3 Omni 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3.8 27B Omnimerge v6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
SE
SenseNova U1.5 8B MoT Q4 K S L0DownFix
Sensenova · GuYueshou
Params17.5B
Context—
Smallest13.2 GB
GGUF
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
DE
DeepSeek Coder V2 Lite Base
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
IN
Inkbot 13B 4k
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
FL
Flint 40B A2.5B 8GB
Flint · anik-jha
Params20.8B
Context256K
Smallest6.5 GB
CodingReasoningTool use
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · Naphula
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.6 27B A3B Coder
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
Coding
QW
Qwen3 VL 12B Thinking Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
CodingReasoningVision
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
GGUF
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
GE
lyrics room suno director v4
Gemma · rambrogi
Params11.9B
Context256K
Smallest12.7 GB
ReasoningTool use
ME
Menage 12B
Menage · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF

Other sizes

Keep browsing