Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
Vision
RE
Redmond Puffin 13B
Redmond · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-13b-chat-bilingual
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
CA
CarbonVillain en 10.7B v4
Carbonvillain · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
BR
Breeze-13B-32k-Instruct-v1_0
Breeze · mradermacher
Params12.7B
Context32K
Q4_K_M7.7 GB
GGUF
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LA
Lambda 17b PcDPO
Lambda · mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
Roleplay
TH
TherapyBeagle 11B v1 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · CrucibleLab
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
FL
FLUX.1 dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
GGUF
PP
pplx decider 27B Artemis
Pplx · turintech
Params26.9B
Context256K
Smallest14.3 GB
ReasoningTool useVision
AR
Artemis 31B v1.1 Heretic v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
ER
ERNIE 4.5 21B A3B PT
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
GGUF
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · EZForever
Params30.7B
Context256K
Smallest17.3 GB
Vision
FA
MN 12B Faun RP RU
Faun · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
Mistral Small 3.2 24B Instruct 2506 ultra uncensored heretic
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
CA
CarbonVillain En 10.7B v4
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SU
sulphur 2
Sulphur · szwagros
Params21B
Context—
Q4_K_M14.2 GB
GGUF
EK
Ekbasis Skopos 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
LU
luxia 21.4b alignment v1.0
Luxia · MaziyarPanahi
Params21.4B
Context32K
Q4_K_M12.9 GB
GGUF
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
ME
Medgemma 27b Text It Abliterated
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GL
GLM 4.7 Flash Heretic
GLM · Olafangensan
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningRoleplayVision
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB
CodingReasoningTool use

Other sizes

Keep browsing