BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8-27B
Qwen · hammadRahman
Params27.3B
Context256K
Q4_K_M16.5 GB
AP
Apodex 1.1 Mini
Apodex · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
GE
Gemma 4 E4B Luchador
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · bartowski
Params593M
Context32K
Q4_K_M0.5 GB
QW
Qwen2-0.5B-Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
GR
Granite-4.0-H-1B
Granite · unsloth
Params1.46B
Context1024K
Q4_K_M0.9 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
PY
Pythia 6.9B Instruct v1 Merged
Pythia · bartowski
Params6.86B
Context2K
Q4_K_M4.7 GB
GP
gpt oss nano
gpt-oss · squ11z1
Params9B
Context128K
Q4_K_M6.8 GB
QW
Qwen3-Vl-2B-Instruct-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
DE
DeepCoder 1.5B Preview
Deepcoder · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSWE Preview
Deepswe · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
XY
Xyntetik Kvist 14B
Xyntetik · Joakimpalm-Zen
Params14.4B
Context128K
Smallest0.0 GB
ST
stable diffusion xl base 1.0
Stable · kostakoff
Params3.47B
Context—
Smallest2.7 GB
QW
Qwen3.8 27B DFlash2
Qwen · Anbeeld
Params1.92B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params403B
Context256K
Q4_K_M248.8 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
YU
Yue2-3B-GGUF
Yue · tungnguyen84
Params677M
Context—
Smallest0.3 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · prithivMLmods
Params7.52B
Context64K
Q4_K_M5.3 GB
SK
Skywork SWE 32B
Skywork · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
US
UserLM 8b
Userlm · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
JA
Jais-3-3.7B
Jais · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
Lfm2.5-1.2B-Thinking
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB