Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
WA
WaifuGemma4 26b a4b v1
Waifugemma · hiwaifu-research
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
ER
Eros Scribe 10.7b v3 i1
Eros · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RP
RPBizkit v11 12B Thinking
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
CA
MN CaptainErisNebula 12B Chimera v1.1 Heretic Uncensored Abliterated
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
SO
SorcererLM 22B iMat
Sorcererlm · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
GE
humanizer-12b
Gemma · npario
Params11.9B
Context256K
Q4_K_M7.6 GB
Vision
QW
Qwen3.8-27B
Qwen · hammadRahman
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
GE
Gemma4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
Vision
MI
Ministral 3 14B Reasoning 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
NO
Noromaid 20b v0.1.1 i1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MA
MN 12B Mag Mell R1 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
EX
Exper Alfa V1 i1
Exper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Small 24B Base 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
XY
Xyntetik Kvist 14B
Xyntetik · Joakimpalm-Zen
Params14.4B
Context128K
Smallest0.0 GB
GGUF
TE
Ternary Bonsai 2 27B abliterated
Ternary · Override-6
Params27B
Context256K
Smallest5.9 GB
GGUF
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic v2
Gemma · OS-Software
Params25.2B
Context256K
Smallest14.2 GB
Vision
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
TE
Bonsai JEV
Ternary · dakebakery
Params26.9B
Context—
Smallest0.2 GB
GGUF
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Pixtral 12B Ollama
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision

Other sizes

Keep browsing