Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
VE
UI Venus 1.5 30B A3B
Venus · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
QW
QWQ_Zero1
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 Coder 14B Instruct Jbliterated
Qwen · ApolloRaines
Params14.8B
Context32K
Q4_K_M9.0 GB
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
HA
MN HaremUnion 12B i1
Haremunion · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GL
Glistening Gem 31B v2.1
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 27B Claude 4.6 OS Auto Variable Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NO
Noromaid 13B v0.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
NU
nucleusai_nucleus-22b-token-500b
Nucleus · TheBloke
Params21.8B
Context2K
Q4_K_M13.2 GB
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · second-state
Params13.1B
Context4K
Q4_K_M8.0 GB
NE
Nethena 20B
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
SA
Sailor2 20B Chat
Sailor · bartowski
Params19.2B
Context32K
Q4_K_M11.6 GB
GE
gemma3
Gemma · libretranslate
Params11.8B
Context32K
Smallest1.0 GB
CO
Code 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TE
Tess 4 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
AI
airoboros l2 13B 3.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PY
PygWin 4x7B
Pygwin · mradermacher
Params19.7B
Context4K
Q4_K_M12.1 GB
QW
Qwen3.8 27B
Qwen · akopytko
Params27.3B
Context—
Smallest0.0 GB
OR
Orca2myth7.2
Orca · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
DA
Dans PersonalityEngine V1.3.0 12b
Dans · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
SQ
sqlcoder
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
LT
ltxv 13b 0.9.7 distilled
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB