BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QE
qev 0.8b
Qev · labqoat
Params752M
Context256K
Smallest0.8 GB
Vision
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
CodingVision
QW
Ornith 1.5 35B A3B Uncensored
Qwen · 0xKitkat
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
QwenDGAF V3 4B
Qwen · hecan3d
Params4B
Context40K
Q4_K_M2.5 GB
Roleplay
GL
Glistening Gem 31B v2.1
Glistening · kin2341
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
XO
XORTRON AgentRICO
Xortron · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
Vision
FA
Falcon H1 7B Instruct
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
IM
Z Image Turbo
Image · tsqn
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
ER
ERNIE 4.5 21B A3B PT
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
GGUF
GE
gemma 4 E4B it heretic
Gemma · igorls
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
MI
Mistral Small 3.2 24B Instruct 2506 ultra uncensored heretic
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3-Vl-2B-Thinking-1M
Qwen · unsloth
Params1.72B
Context977K
Q4_K_M1.1 GB
ReasoningVision
NO
nomic ai nomic embed code
Nomic · bartowski
Params7.1B
Context32K
Q4_K_M4.4 GB
CodingEmbedding
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingVision
GL
GLM 4.7 Flash Heretic
GLM · Olafangensan
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningRoleplayVision
DO
DoItYourself v1 2B
Doityourself · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
MI
MiMo-V2.6-Pro-MOPD
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
GGUF
QW
Nyx RP 9B Instruct 2608 v1
Qwen · Indexnusrefather
Params9.2B
Context256K
Q4_K_M5.8 GB
Roleplay
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
GR
GRM 2.6 Plus 0628
Grm · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
HO
Holo 3.1 9B
Holo · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Roleplay

Other quants

Keep browsing