Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
UI Venus 1.5 30B A3B
Venus · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
QW
QWQ_Zero1
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen2.5 Coder 14B Instruct Jbliterated
Qwen · ApolloRaines
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
HA
MN HaremUnion 12B i1
Haremunion · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
Glistening Gem 31B v2.1
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 OS Auto Variable Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
NO
Noromaid 13B v0.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
NU
nucleusai_nucleus-22b-token-500b
Nucleus · TheBloke
Params21.8B
Context2K
Q4_K_M13.2 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · second-state
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
NE
Nethena 20B
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SA
Sailor2 20B Chat
Sailor · bartowski
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
GE
gemma3
Gemma · libretranslate
Params11.8B
Context32K
Smallest1.0 GB
GGUF
CO
Code 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
TE
Tess 4 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
AI
airoboros l2 13B 3.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
GGUF
QW
Qwen3.8 27B
Qwen · akopytko
Params27.3B
Context—
Smallest0.0 GB
GGUF
OR
Orca2myth7.2
Orca · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
DA
Dans PersonalityEngine V1.3.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
CodingRoleplay
SQ
sqlcoder
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
Coding
LT
ltxv 13b 0.9.7 distilled
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
GGUF
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use

Other sizes

Keep browsing