Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
Bernini R GGUF ComfyUI
Bernini · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
DA
Dans PersonalityEngine V1.1.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
SE
SexyGPT v3 Thinking Female
Sexygpt · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
PS
Psyonic Cetacean Ultra Quality 20b GGUF imatrix
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
CA
Carnice V3
Carnice · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Tool useVision
SM
Smaug Humanizer
Smaug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · prakharprasad
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
PY
Python Code 13B
Python · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
QW
Qwen3.6 27B Abliterated Heretic Uncensored BF16 v4
Qwen · Youssofal
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 Dark Thoughts V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Qwen2.5 14B Instruct
Qwen · ThomasBaruzier
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 27B Heretic Uncensored Q4 K M
Qwen · mlasli
Params27.3B
Context256K
Q4_K_M17.0 GB
Roleplay
GR
Grug 27b
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningTool useVision
LF
LFM2.5 24B A2B Uncensored2
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
HU
HunyuanVideo I2V
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
LL
Colossal LLaMA 2 13b Base
Llama · mradermacher
Params13.4B
Context4K
Q4_K_M8.1 GB
GGUF
D3
d3
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
ME
Mero Artemis 31B v1
Mero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
QW
Qwen2.5 32B ArliAI RPMax v1.3
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
FL
flux.1dev abliterated
Flux · raidenzeke
Params11.9B
Context—
Smallest12.7 GB
GGUF
QW
Qwen3.6 27B OBLITERATED
Qwen · OBLITERATUS
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored JoyFox Aggressive
Qwen · joyfox
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
BO
Bonsai 27b 1bit CRACK
Bonsai · dealignai
Params27B
Context256K
Smallest4.7 GB
ReasoningTool useVision
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
mistralai_Ministral 3 14B Instruct 2512 BF16
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
QW
Qwen3.8-27B
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
ReasoningVision
QW
Qwen3 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF

Other sizes

Keep browsing