BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Qwen3 4B Thinking 2507 MiMo V2 Flash Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GGUF
QW
QwenDGAF 0.6B
Qwen · hecan3d
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
HE
Hemmingway 1 VL
Hemmingway · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GR
Granite-4.0-1B
Granite · unsloth
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
ST
StandardOne 3B
Standardone · StandardThinking
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
ER
ERNIE 4.5 21B A3B Thinking
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
Reasoning
AP
APUS OpenJev v1 9B
Apus · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
AB
Absolute_Zero_Reasoner Coder 14b
Absolute · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
WA
Wan2.1 Fun 14B InP
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
Carnice V2 27b
Carnice · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
Tool use
BO
Borealis 1b
Borealis · NbAiLab
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
TE
Tessera 27B B CJK
Tessera · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
CO
Cozum 4B
Cozum · Yigit-Karaman
Params4.2B
Context256K
Q4_K_M2.7 GB
Vision
LL
Impish_LLAMA_4B
Llama · bartowski
Params4.5B
Context128K
Q4_K_M2.8 GB
GGUF
IN
Januscoder-8B
InternLM · unsloth
Params8.19B
Context32K
Q4_K_M5.0 GB
CodingVision
GE
Gemma 4 26B A4B it qat NVFP4
Gemma · WhiskyAKM
Params25.2B
Context256K
Smallest0.3 GB
Vision
PA
palmyra mini thinking AIO
Palmyra · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.0 GB
CodingReasoning
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Vladimir13569
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
AP
Apriel-1.5-15B-Thinker
Apriel · unsloth
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
GE
Gemma 4 E4B It
Gemma · giladgd
Params7.5B
Context128K
Q4_K_M5.4 GB
Vision
TH
AM Thinking v1
Thinking · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
PH
Phi 3 mini 4k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
QW
Qwq-32B
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
GGUF
OP
knoveleng Open RS3
Open · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF

Other quants

Keep browsing