Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
GGUF
SO
SOR ColdBrew 12B Think RP Base
Sor · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
Embedding
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
Vision
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
NA
Nanbeige4.3 33B Uncensored
Nanbeige · XTer123
Params33.1B
Context512K
Smallest23.5 GB
ReasoningTool use
MI
maywell_pivot-10.7b-mistral-v0.2-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GP
Gpt Oss 20b Unsloth Puzzle V2
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
LL
models--mergekit-community--Llama3-13B-ku
Llama · MaziyarPanahi
Params23B
Context8K
Q4_K_M13.9 GB
Tool use
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
llama 2 13B chat limarp v2 merged
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GR
GRM 2.6 Plus 0628
Grm · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
MO
Mox Small 1
Mox · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GE
Tiger Gemma 12B v3
Gemma · TheDrummer
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
QW
Qwen2.5 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
EV
rombodawg_everyone-coder-33b-base
Everyone · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
Roleplay
DA
DaringMaid 20B V1.1 i1
Daringmaid · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GL
Glm-4.7-Flash
GLM · mudler
Params29.9B
Context198K
Smallest11.9 GB
GGUF
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF

Other sizes

Keep browsing