Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Q4_K_M5.5 GB
MO
L3 4X8B MOE Dark Planet Infinite 25B
Moe · DavidAU
Params24.9B
Context8K
Q4_K_M15.2 GB
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
VE
VeriLoop E2
Veriloop · tsinghua-sigs-robot-lab
Params27B
Context256K
Q4_K_M19.7 GB
LT
LTX 2.5 22b distilled
Ltx · elix3r
Params21B
Context—
Smallest16.9 GB
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · saidutta69
Params14.8B
Context128K
Q4_K_M9.0 GB
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.6 21B IQ Ultra Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
KR
Krea R Turbo
Krea · realrebelai
Params12.8B
Context—
Q4_K_M7.7 GB
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · mbakgun
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
qwen2.5 14B roleplay zh Q4 K M
Qwen · TouchNight
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Big Tiger Gemma 27B v3
Gemma · bartowski
Params28.4B
Context128K
Q4_K_M17.3 GB
LL
models--mergekit-community--Llama3-12B-wwe
Llama · MaziyarPanahi
Params13.7B
Context8K
Q4_K_M8.3 GB
QW
Qwen3 14B GPT 5.2 High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
KA
Kataguru Industry MVP 27B v1.1
Kataguru · kataguru
Params26.9B
Context256K
Q4_K_M2.0 GB
GR
Granite 4.2 30b
Granite · bartowski
Params29.3B
Context128K
Q4_K_M18.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ST
StagAI CyberSecurity 26B A4B v2 VLM GGUF Q8
Stagai · deer-sec
Params25.2B
Context256K
Smallest26.9 GB
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB