Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
HornyEchidna 13B v0.1
Hornyechidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GP
Jinx Gpt Oss 20b
gpt-oss · Jinx-org
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
Qwen 3.8 27b Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
Mistral Nemo Instruct 2407 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
S1
S1 VL 32B
mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningTool useVision
QW
Qwen Qwen3 Coder 30B A3B Instruct
Qwen · tensorblock
Params30.5B
Context256K
Smallest11.3 GB
Coding
FI
Fimbulvetr 40 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LI
Lilith 31B v1.0
Lilith · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
SO
SOLAR Platypus 10.7B v2
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AU
Augmental ReMM 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chaotic Order 24B V3
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Smallest7.6 GB
Vision
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
LF
LFM2.5 24B A2B
Lfm · WhiskyAKM
Params24B
Context128K
Smallest13.6 GB
GGUF
QW
Qwen3 30B A3B ArliAI RpR v4 Fast
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
MA
openaccess-ai-collective_manticore-13b
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
ZI
idea-ccnl_ziya-coding-34b-v1.0
Ziya · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AI
bhenrym14_airoboros-l2-13b-2.1-yarn-64k
Airoboros · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
GE
gemma-4-31B-it-uncensored-biproj
Gemma · ressl
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
MN 12B Celeste V1.9
Qwen · adrose98
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
Llama 3.2 3B MoE 4Expert
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
Coding
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
PR
T pro it 2.1
Pro · t-tech
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Roleplay
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF

Other sizes

Keep browsing