Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Q4_K_M5.5 GB
GGUF
MO
L3 4X8B MOE Dark Planet Infinite 25B
Moe · DavidAU
Params24.9B
Context8K
Q4_K_M15.2 GB
Roleplay
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
VE
VeriLoop E2
Veriloop · tsinghua-sigs-robot-lab
Params27B
Context256K
Q4_K_M19.7 GB
Reasoning
LT
LTX 2.5 22b distilled
Ltx · elix3r
Params21B
Context—
Smallest16.9 GB
GGUF
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · saidutta69
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.6 21B IQ Ultra Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
ReasoningRoleplay
KR
Krea R Turbo
Krea · realrebelai
Params12.8B
Context—
Q4_K_M7.7 GB
GGUF
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · mbakgun
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
QW
qwen2.5 14B roleplay zh Q4 K M
Qwen · TouchNight
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
GE
Big Tiger Gemma 27B v3
Gemma · bartowski
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
LL
models--mergekit-community--Llama3-12B-wwe
Llama · MaziyarPanahi
Params13.7B
Context8K
Q4_K_M8.3 GB
Tool use
QW
Qwen3 14B GPT 5.2 High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
KA
Kataguru Industry MVP 27B v1.1
Kataguru · kataguru
Params26.9B
Context256K
Q4_K_M2.0 GB
ReasoningTool useVision
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
ReasoningTool use
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
Coding
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
ST
StagAI CyberSecurity 26B A4B v2 VLM GGUF Q8
Stagai · deer-sec
Params25.2B
Context256K
Smallest26.9 GB
ReasoningTool useVision
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other sizes

Keep browsing