BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
IN
Inkling-Small
Inkling · unsloth
Params264B
Context1024K
Q4_K_M162.5 GB
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · HauhauCS
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
MiniMax-Music
Minimax · audio-cpp
Params4.9B
Context—
Smallest0.1 GB
GE
gemma 4 E2B it qat mobile
Gemma · unsloth
Params92M
Context128K
Smallest0.1 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · AtomicChat
Params8.19B
Context256K
Smallest3.3 GB
QW
Qwen3.8 4B
Qwen · empero-ai
Params4.33B
Context256K
Q4_K_M2.8 GB
YU
YuE2 LM
Yue · scragnog
Params3.8B
Context24K
Q4_K_M2.4 GB
QW
Qwen3.8-27B-Uncensored-Cyber
Qwen · philbert440
Params27B
Context256K
Q4_K_M19.0 GB
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
QW
Qwen3.8 9B
Qwen · empero-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
LF
LFM2.5 2.6B
Lfm · LiquidAI
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3.8 2B
Qwen · empero-ai
Params1.94B
Context256K
Q4_K_M1.3 GB
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Ternary Bonsai 27B
Qwen · prism-ml
Params3.6B
Context4K
Smallest1.9 GB
MI
Voxtral Mini 4B Realtime
Mistral · handy-computer
Params4.43B
Context—
Q4_K_M2.8 GB
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Q4_K_M96.0 GB
OR
Ornith 1.5 122B
Ornith · ornith-ai
Params125B
Context256K
Q4_K_M75.8 GB
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
QW
Qwen3.8-27B-DFlash2
Qwen · z-lab
Params1.92B
Context256K
Q4_K_M1.1 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
QW
Qwen3.8 Flash Next NVFP4 GPTQ Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB