Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Promethean Dawn 26B A4B
Promethean · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen2.5 Coder 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b i1
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen3.8-27B
Qwen · kingjones777
Params26.9B
Context256K
Smallest1.7 GB
Vision
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
SA
Sabi Noema
Sabi · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Tool use
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
JonathanColetti Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
GGUF
LT
LTX2.3 10Eros
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
GGUF
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
DEV ThinkingCap Qwen3.8 27B
Qwen · ngquocvinh
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
RO
Rocinante X 12B v1 Heretic Uncensored
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
CA
Carbon-X
Carbon · HuggingFaceBio
Params14.8B
Context40K
Q4_K_M9.6 GB
ReasoningTool use
GE
BgGPT Gemma 3 27B IT
Gemma · INSAIT-Institute
Params27B
Context128K
Q4_K_M16.5 GB
Vision
ME
Medgemma-27B-Text-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningVision
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Reasoning
KR
Krea 2 Raw
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
TW
Twilight Embrace 31B
Twilight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
ReasoningTool use
MI
Ministral 3 14B Reasoning 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · kaitchup
Params27.3B
Context256K
Smallest18.9 GB
ReasoningTool use

Other sizes

Keep browsing