Flux GGUF models

357 GGUF models in the Flux family, quantized by 221 uploaders. Sizes run from 65M to 32.2B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
FL
FLUX.1 dev
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
FL
FLUX.1 schnell
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
GGUF
FL
Flux2 Klein 9B True V2
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
FL
FLUX.1 Fill dev
Flux · YarvixPA
Params11.9B
Context—
Smallest5.2 GB
GGUF
FL
FLUX.2 klein 4B
Flux · leejet
Params3.88B
Context—
Smallest2.5 GB
GGUF
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
GGUF
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
GGUF
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
FL
flux 3 image klein
Flux · leejet
Params5.55B
Context—
Smallest2.3 GB
GGUF
FL
FLUX.1 schnell
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
FL
FLUX.1 dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
FL
FLUX 3 Image Klein GGUFs
Flux · realrebelai
Params5.54B
Context—
Q4_K_M3.4 GB
GGUF
FL
FLUX.2 klein 9B
Flux · leejet
Params9.08B
Context—
Smallest5.6 GB
GGUF
FL
Flux2 Klein 9B True V3
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
FL
flux klein 9b Biglove Collection
Flux · Granddyser
Params9.08B
Context—
Smallest6.5 GB
GGUF
FL
flux.1 dev abliterated V2
Flux · t8star
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
FL
FLUX.1 schnell
Flux · leejet
Params11.9B
Context—
Smallest4.1 GB
GGUF
FL
FLUX 3 Image Klein
Flux · AtomicChat
Params5.55B
Context256K
Smallest2.5 GB
GGUF
FL
flux2 klein 9b uncensored text encoder
Flux · ponpoke
Params8.19B
Context—
Q4_K_M5.0 GB
Coding
FL
flux 3 image klein pup
Flux · unsloth
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
GGUF
FL
flux 3 image klein sd
Flux · Abiray
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
GGUF
FL
flux2 klein 4b uncensored text encoder
Flux · ponpoke
Params4B
Context—
Q4_K_M2.5 GB
Coding
FL
PornMaster Klein 9b
Flux · rectangleworm
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF

About the Flux GGUF models

Flux is represented on ggufmodels.com by 357 GGUF models, quantized by 221 uploaders on Hugging Face. The most downloaded are FLUX.2 klein 4B, FLUX.2 klein 9B and FLUX.1 dev. Parameter counts run from 65M to 32.2B, and the longest trained context window is 256K tokens.

A Q4_K_M file of a Flux model is between 0.1 to 21.0 GB, which is the quant most people start with. Most files come from unsloth (11), ND911 (11) and wikeeyang (9). The quants you will meet most often are Q8_0 (239), Q6_K (162), Q4_K_M (138) and Q4_0 (123), where the number is how many models offer that quant.

Frequently asked questions

Which Flux GGUF should I download?

The most downloaded Flux GGUF here is FLUX.2 klein 4B. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Flux model need?

Q4_K_M files of Flux models on this site range from 0.1 to 21.0 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Flux GGUF files come from?

The most common quantizers here are unsloth, ND911 and wikeeyang. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing