Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
BR
Broken Tutu 24B Transgression v2.0
Broken · Naofan
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.5 14B Instruct
Qwen · legraphista
Params14.8B
Context32K
Smallest3.6 GB
QW
Qwen3 VL 32B Ultra Heretic Minimax H3
Qwen · eraiko
Params25.2B
Context256K
Smallest17.8 GB
BO
Bookworm 10.7B v0.4 DPO
Bookworm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GP
GPT4 X Alpasta 30b
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GI
GigaChat 20B A3B instruct v1.5
Gigachat · ai-sage
Params20.6B
Context128K
Q4_K_M12.5 GB
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Huihui Qwen3 Omni 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.8 27B Omnimerge v6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
SE
SenseNova U1.5 8B MoT Q4 K S L0DownFix
Sensenova · GuYueshou
Params17.5B
Context—
Smallest13.2 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · QuantFactory
Params15.7B
Context160K
Q4_K_M10.4 GB
IN
Inkbot 13B 4k
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FL
Flint 40B A2.5B 8GB
Flint · anik-jha
Params20.8B
Context256K
Smallest6.5 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · Naphula
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen3.6 27B A3B Coder
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
QW
Qwen3 VL 12B Thinking Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
GE
lyrics room suno director v4
Gemma · rambrogi
Params11.9B
Context256K
Smallest12.7 GB
ME
Menage 12B
Menage · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB