BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
ReasoningVision
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · llmfan46
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
SA
Saiga_Yandexgpt_8B_Sft_M4_D19_Hf
Saiga · IlyaGusev
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
GGUF
YU
Ruach Studio Models v2
Yue · goldhub
Params632M
Context32K
Q4_K_M4.7 GB
Vision
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Andycurrent
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
GGUF
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
MO
MOSS TTS Realtime
Moss · BricksDisplay
Params2.08B
Context40K
Q4_K_M1.1 GB
GGUF
CO
CogEvol 4B
Cogevol · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
CO
Codex 24B Small 3.2
Codex · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
D1
d1 3B
AtomicChat
Params2.7B
Context32K
Q4_K_M1.7 GB
ReasoningTool useVision
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
QW
Qwen3 VL 8B Thinking Unredacted MAX
Qwen · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
ReasoningVision
QW
Qwen3.8 4b Heretic Trial23
Qwen · hakergeniusz
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
VE
VeriLoop E2
Veriloop · tsinghua-sigs-robot-lab
Params27B
Context256K
Q4_K_M19.7 GB
Reasoning
QW
Qwen3.5 35B A3B uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
ReasoningTool use
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
GGUF
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
GGUF

Other quants

Keep browsing