Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 27B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
JE
Jev Omni Q4 K M
Jev · Reza2kn
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
TR
Translategemma 27b It
Translategemma · bullerwins
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Josiefied Qwen3 14B Abliterated v3
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
PH
phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MX
MXLewd L2 20B i1
Mxlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
LL
LLaMA2 13B Psyfighter2
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · mudler
Params24B
Context128K
Smallest7.7 GB
GGUF
QW
QiMing Holos Plus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
UN
Hy MT2 30B A3B Uncensored Heretic
Uncensored · alphaZimuth
Params30B
Context256K
Smallest9.7 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
SU
Sulphur 2 distilled Q4 K M
Sulphur · coolthor
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
Qwen3.8 27B Heretic Uncensored Q5 K M
Qwen · mlasli
Params27.3B
Context256K
Smallest19.7 GB
Roleplay
EV
totally-not-an-llm_everythinglm-13b-v3-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LT
LTX2.3 10Eros 1.2
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
Mistral Nemo 12B Instruct
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
EH
ehartford_wizardlm-13b-v1.0-uncensored
Ehartford · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GP
GPT OSS Cybersecurity 20B Merged Heretic
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
codellama_codellama-13b-python-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
WA
wan22EnhancedNSFWSVICamera nsfwV2Q6KH
Wan · tree03
Params14.3B
Context—
Smallest12.0 GB
GGUF
GE
Gemory 26B A4B SOMPOA
Gemory · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
ReasoningTool useVision
ME
Melody1437 12B v0.5
Melody · ReadyArt
Params11.9B
Context256K
Q4_K_M8.6 GB
Roleplay
NO
Noromaid 20B v0.1.1
Noromaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SH
Shadow Siren 26B A4B
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
SO
SOLAR 10.7B Instruct v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Other sizes

Keep browsing