BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
OR
Ornith 1.5 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GE
Huihui gemma 4 E4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params7.46B
Context128K
Smallest0.2 GB
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
LF
LFM3 1.7B
Lfm · LiquidAI
Params1.73B
Context256K
Q4_K_M1.1 GB
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · PhillyLabs
Params2.7B
Context125K
Smallest5.4 GB
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
FL
Flint-40B-A2.5B-abliterated
Flint · dima6312
Params39.8B
Context256K
Q4_K_M24.2 GB
HO
K2 Horizon 3.7B
Horizon · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
GI
GigaChat3.1 10B A1.8B
Gigachat · ai-sage
Params10.7B
Context256K
Q4_K_M6.5 GB
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
JE
JEV 27B VL
Jev · Atlas3D
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
QW
OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata
Qwen · Maximilian228
Params4.95B
Context—
Smallest1.3 GB
FL
vllm-d3-flash
Flash · ggml-org
Params8.95B
Context256K
Q4_K_M6.6 GB
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Ming 3.0 TTS 0.5B
Ming · audio-cpp
Params1.6B
Context—
Smallest1.7 GB
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
SP
Spark X2.6 4B
Spark · bartowski
Params4.11B
Context1024K
Q4_K_M2.6 GB
NA
Nanbeige4.2 3B
Nanbeige · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
QW
Qwen3 14B Claude 4.5 Opus High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 ASR 0.6B
Qwen · ggml-org
Params752M
Context64K
Smallest0.8 GB