Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
SO
SOR ColdBrew 12B Think RP Base
Sor · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
NA
Nanbeige4.3 33B Uncensored
Nanbeige · XTer123
Params33.1B
Context512K
Smallest23.5 GB
MI
maywell_pivot-10.7b-mistral-v0.2-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GP
Gpt Oss 20b Unsloth Puzzle V2
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
models--mergekit-community--Llama3-13B-ku
Llama · MaziyarPanahi
Params23B
Context8K
Q4_K_M13.9 GB
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
LL
llama 2 13B chat limarp v2 merged
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GR
GRM 2.6 Plus 0628
Grm · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
MO
Mox Small 1
Mox · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GE
Tiger Gemma 12B v3
Gemma · TheDrummer
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
QW
Qwen2.5 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
EV
rombodawg_everyone-coder-33b-base
Everyone · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
DA
DaringMaid 20B V1.1 i1
Daringmaid · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
LL
CodeLlama 34b Instruct Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
GL
Glm-4.7-Flash
GLM · mudler
Params29.9B
Context198K
Smallest11.9 GB
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB