Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Carl Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.6 27B Abliterated MTP
Qwen · gaston-parravicini
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · mmnga
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
QW
Rombos Coder V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
QW
Qwen3.8-27B
Qwen · Snowwhite00
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 32B Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
NQLSG Qwen2.5 14B MegaFusion v5 Roleplay
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
SL
Slimaki 24B v1
Slimaki · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
PS
Psyfighter2 13B Vore
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
IA
Iambe 20B DARE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
LLama 3.1 128k Darkest Planet Uncensored 16.5B
Llama · DavidAU
Params16.5B
Context128K
Q4_K_M10.0 GB
Roleplay
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
PO
Polar 32B
Polar · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
STEM Oracle
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
Reasoning
GE
Gemma 4 12B It
Gemma · giladgd
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
BugTraceAI CORE Ultra 27B Q6
Qwen · BugTraceAI
Params26.9B
Context256K
Smallest22.1 GB
ReasoningTool use
GP
gpt-oss-20b-VISION-v2
gpt-oss · SoAIHQ
Params20.9B
Context128K
Smallest13.8 GB
ReasoningTool useVision
TE
Terminal RSI 27B
Terminal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
DA
MN Dark Planet TITAN 12B
Dark · DavidAU
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
ReasoningVision
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Qwen2.5 2X7B Coder VisCoder Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
Coding
UN
UNA POLAR 10.7B InstructMath v2 i1
Una · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llm Jp 4.1 33b Thinking
Llm · OS-Software
Params33.2B
Context64K
Q4_K_M20.4 GB
Reasoning
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
ReasoningRoleplayTool use
MY
L3-15B-MythicalMaid-t0.0001
Mythicalmaid · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
GP
OpenAi GPT oss 20b MODERATE uncensored NEO Imatrix
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB
CodingReasoning

Other sizes

Keep browsing