Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · ISTA-DASLab
Params177B
Context256K
Smallest66.4 GB
Vision
OR
Ornith-1.5-35B
Ornith · ornith-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
Vision
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · ISTA-DASLab
Params197B
Context—
Smallest110.6 GB
GGUF
OR
Ornith 1.0 35B
Ornith · ornith-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
Vision
DE
DeepSeek V4.1 Flash Vision Encoder
DeepSeek · antirez
Params1400B
Context—
Smallest1.0 GB
GGUF
QW
Qwen3.8 35B A3B Distill
Qwen · empero-ai
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningVision
OR
Ornith-1.5-397B
Ornith · ornith-ai
Params403B
Context256K
Q4_K_M244.3 GB
Vision
QW
Qwen3.8 Flash Next Uncensored
Qwen · orcarouter
Params177B
Context256K
Q4_K_M119.2 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next
Qwen · unsloth
Params177B
Context256K
Q4_K_M1.9 GB
Vision
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · ISTA-DASLab
Params260B
Context256K
Smallest58.4 GB
CodingVision
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.0 GB
Vision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
HU
Cyber Tiel Coder 35B A3B GGUF MTP
Huihui · peculiar-ragdoll
Params35.5B
Context256K
Q4_K_M22.5 GB
CodingReasoningTool use
GL
GLM 5.3 Flash
GLM · unsloth
Params320B
Context1024K
Smallest93.1 GB
Vision
KA
KAT Coder V2.5 Dev APEX
Kat · mudler
Params34.7B
Context256K
Smallest13.5 GB
Coding
OC
Occamy 1.0
Occamy · Accio-Lab
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO
Qwen · ukisai
Params177B
Context—
Smallest0.6 GB
ReasoningVision
IN
Inkling-Small
Inkling · unsloth
Params264B
Context1024K
Q4_K_M162.5 GB
ReasoningVision
GL
GLM 5.3 Flash Maya
GLM · peasantsmith
Params370B
Context64K
Smallest0.0 GB
Vision
QW
Qwen3.8 Flash Next Gyro
Qwen · agentionai
Params177B
Context256K
Smallest2.7 GB
ReasoningTool useVision
DA
POCKET 35B
Darwin · FINAL-Bench
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · AtomicChat
Params177B
Context256K
Q4_K_M94.5 GB
ReasoningTool useVision
GL
orcarouter GLM 5.3 Flash Uncensored
GLM · BoldingBuilds
Params321B
Context1024K
Smallest97.1 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
ReasoningTool useVision
AP
Apodex 1.1 Mini
Apodex · abenzerps
Params35.5B
Context256K
Q4_K_M19.8 GB
Vision
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Q4_K_M96.0 GB
GGUF

What counts as a large model?

On this site large means 35B parameters and up. A Q4_K_M file is usually 22 GB or more, so you need a 24 GB or larger GPU, several GPUs or a lot of system RAM. 15,744 models fit this class. The most downloaded are Qwen3.8 Flash Next GSQ RCO, Ornith-1.5-35B and Qwen3.8 Flash Next GSQ RCO abliterated.

Their Q4_K_M files run 0.0 to 1481.4 GB. The families you will see most are Qwen (3189), Llama (2784) and DeepSeek (761). The size class sorts models by parameter count, so a model with more experts or a longer context can need more memory than its class suggests. The model pages show the real file sizes.

Frequently asked questions

How much VRAM does a large GGUF model need?

A Q4_K_M file is usually 22 GB or more, so you need a 24 GB or larger GPU, several GPUs or a lot of system RAM.

Which large GGUF model is the most popular?

By Hugging Face downloads, Qwen3.8 Flash Next GSQ RCO.

Other sizes

Keep browsing