Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LL
Carl Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.6 27B Abliterated MTP
Qwen · gaston-parravicini
Params27.3B
Context256K
Q4_K_M16.8 GB
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
QW
Rombos Coder V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3.8-27B
Qwen · Snowwhite00
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 Coder 32B Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
NQLSG Qwen2.5 14B MegaFusion v5 Roleplay
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SL
Slimaki 24B v1
Slimaki · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
PS
Psyfighter2 13B Vore
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
IA
Iambe 20B DARE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
LL
LLama 3.1 128k Darkest Planet Uncensored 16.5B
Llama · DavidAU
Params16.5B
Context128K
Q4_K_M10.0 GB
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
PO
Polar 32B
Polar · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
STEM Oracle
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 12B It
Gemma · giladgd
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
BugTraceAI CORE Ultra 27B Q6
Qwen · BugTraceAI
Params26.9B
Context256K
Smallest22.1 GB
GP
gpt-oss-20b-VISION-v2
gpt-oss · SoAIHQ
Params20.9B
Context128K
Smallest13.8 GB
TE
Terminal RSI 27B
Terminal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
DA
MN Dark Planet TITAN 12B
Dark · DavidAU
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.5 2X7B Coder VisCoder Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
UN
UNA POLAR 10.7B InstructMath v2 i1
Una · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llm Jp 4.1 33b Thinking
Llm · OS-Software
Params33.2B
Context64K
Q4_K_M20.4 GB
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
MY
L3-15B-MythicalMaid-t0.0001
Mythicalmaid · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GP
OpenAi GPT oss 20b MODERATE uncensored NEO Imatrix
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB