Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
Captain Eris Diogenes Twilight V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
PS
PsyMedLewdReMM Inverted 20B
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct Uncensored Patched
Qwen · SSDD145
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Models Qwen Qwen2.5 32B Instruct
Qwen · MaziyarPanahi
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
ME
Melody1437 26B A4B
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · ManniX-ITA
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
LF
Abliterated
Lfm · alexwkleung
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
LE
LeoLM hessianai 13b
Leolm · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
CO
comfyui image models
Comfyui · ChuuniZ
Params11.9B
Context—
Smallest6.8 GB
GGUF
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Moe 4x7b reason code qa i1
Moe · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
CodingReasoning
JE
Jev-Omni
Jev · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
WebWorld 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · Acelogicdev
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
GGUF
QW
Qwen2.5 14B_Uncencored_Instruct
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · DhruvalLabs
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
QW
Qwen Qwen3.8 27B GGUF IQ1 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · LoneStriker
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
NO
NovaSage 24B
Novasage · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay

Other sizes

Keep browsing