BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OV
OvisOCR2
Ovisocr · Abiray
Params752M
Context256K
Q4_K_M0.5 GB
Vision
GR
Granite 4.2 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
ReasoningTool use
OR
Ornith-1.5-9B
Ornith · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
GGUF
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
GL
GLM 5.3 Flash DFlash2
GLM · Anbeeld
Params1.17B
Context1024K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · legraphista
Params3.21B
Context128K
Smallest0.9 GB
GGUF
QW
qwen image
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
GGUF
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
Minimax-M2.1
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
IN
InternVL3_5 14B
Internvl · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Vision
CO
Cosmos-Reason1-7B
Cosmos · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.8 27B Uncensored Heretic Native MTP Preserved NVFP4
Qwen · llmfan46
Params27.3B
Context256K
Smallest16.9 GB
Vision
GE
Gemma 3 4b It Qat
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
KI
Kimi-K2.6
Kimi · unsloth
Params1030B
Context256K
Smallest340.5 GB
Vision
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LI
LightOnOCR 3 0.8B
Lightonocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Tool useVision
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
Tool use
ST
stable diffusion v1 5
Stable · kostakoff
Params1.07B
Context—
Smallest2.2 GB
GGUF
RA
Raon 1 mini preview
Raon · NANI-Nithin
Params28.8B
Context256K
Q4_K_M19.7 GB
ReasoningTool use
IN
InternVL3_5 30B A3B
Internvl · bartowski
Params30.5B
Context40K
Q4_K_M18.6 GB
Vision
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
QW
Qwen3.5-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
MI
MiniMax-3.1-Flash-DeRisked
Minimax · freakyskittle
Params426B
Context1024K
Q4_K_M258.0 GB
ReasoningTool useVision
OL
Olmo 3.1 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning

Other quants

Keep browsing