Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma4
Gemma · wwlwwl
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingRoleplay
HE
Hermes 4 14B
Hermes · gabriellarson
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
LT
LTX2.3 10Eros 1.4 Split
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
AR
Artemis 31B v1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GE
Gemma 4 31B It Qat Q4_0 Uncensored Heretic
Gemma · OS-Software
Params30.7B
Context256K
Smallest17.3 GB
Vision
JE
Jebadiah 27b v2 1
Jebadiah · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
QW
Qwen3.8 27B NVFP4
Qwen · akopytko
Params27.3B
Context256K
Smallest15.7 GB
Vision
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
GGUF
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
14B Qwen2.5 Kunou v1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SP
Split Untied 31B
Split · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview v0.1
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
RU
MN 12B Runeweaver RP RU
Runeweaver · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
PH
Phonellm Mini Alpha 2
Phonellm · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
D3
d3-27B Artemis 12.3GB
turintech
Params26.9B
Context256K
Smallest12.3 GB
ReasoningTool use
QW
Qwen3.8 27B Heretic Uncensored MTP
Qwen · Unb0rn
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
OL
Olmo-3-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
GE
Gemma4 Gutenberg 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
CA
CantoneseLLM v2.0 30B A3B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
Reasoning
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
NO
Noromaid 13B 0.4 DPO i1
Noromaid · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Starcoderplus
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding

Other sizes

Keep browsing