Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GR
Groot 19B A3B 261023
Groot · bartowski
Params19B
Context256K
Q4_K_M12.5 GB
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.8 27B Q3 K M
Qwen · Chungulus
Params27.3B
Context256K
Smallest13.5 GB
QW
Qwen3.5 27B Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CO
Confucius4 T3PO
Confucius · netease-youdao
Params14.8B
Context32K
Smallest10.5 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
LT
LTX 2
Ltx · vantagewithai
Params18.9B
Context—
Q4_K_M12.8 GB
PS
Psyonic Cetacean Ultra Quality 20b GGUF imat plus2
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
VE
Veloxy Titan 32B
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5-24B-A2B
Lfm · OS-Software
Params24B
Context128K
Q4_K_M14.5 GB
ST
StartLux Decision v1 27B BF16
Startlux · startlux-models
Params27B
Context256K
Smallest53.8 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen Image Edit
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
ME
G4 MeroMero 26B A4B
Meromero · zerofata
Params25.2B
Context256K
Q4_K_M16.8 GB
JI
JiRackUltra_32b
Jirackultra · CMSManhattan
Params32.8B
Context128K
Q4_K_M19.9 GB
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
JE
Jeffan 31b 1710
Jeffan · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
AS
Asmodeus 24B v3
Asmodeus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B
Qwen · ArtomYuan
Params27.3B
Context256K
Smallest14.6 GB
LL
Llm Jp 4.1 32b A3B Thinking
Llm · OS-Software
Params32B
Context64K
Q4_K_M21.5 GB
FA
FastH3 Omni GGUFs
Fastvideo · realrebelai
Params22.1B
Context—
Q4_K_M13.8 GB
KR
krea2 turbo uncensored v1.1 BACKUP
Krea · Quiho
Params12.8B
Context—
Q4_K_M7.2 GB
QW
Qwen3.8 27B uncensored
Qwen · ressl
Params27.3B
Context256K
Q4_K_M16.8 GB
GL
Glistening Gem 31B v2.1
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
LU
G4 LuneLight 31B
Lunelight · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
SH
Shadow Siren 14B Pruned
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB