BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Saiga_Gemma3_12B
Gemma · IlyaGusev
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Huihui Qwen3.6 35B A3B abliterated NVFP4
Qwen · vladimir94
Params34.7B
Context256K
Smallest3.7 GB
ReasoningTool useVision
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
LF
LFM2.5 VL 3B Heretic
Lfm · AX1Y2JP
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
DH
Dhanishtha 2.0 Preview 0825
Dhanishtha · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
TE
Tessa T1 7B
Tessa · bartowski
Params7.62B
Context117K
Q4_K_M4.7 GB
Tool use
QW
Qwen3-TTS-Tokenizer-12Hz
Qwen · CC-TM
Params915M
Context—
Q4_K_M0.3 GB
GGUF
MI
MiniCPM V 4.6
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B
Qwen · LeeMantras
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
KA
KAT Coder V2.5 Dev
Kat · RemySkye
Params34.7B
Context256K
Q4_K_M21.2 GB
Coding
MI
MiniCPM5 1B
MiniCPM · RemySkye
Params1.08B
Context128K
Q4_K_M0.7 GB
Tool use
ON
OneDecision VisionGuard 27B SFT
Onedecision · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3 4B Thinking 2507 Heretic
Qwen · ZuzeTt
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
TE
Ternary Bonsai 2 9B Hf Bf16
Ternary · mradermacher
Params8.95B
Context256K
Smallest2.9 GB
ReasoningTool useVision
QW
Qwen2.5-Omni-7B
Qwen · Sci-fi-vy
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwopus3.5 4B v3 MTP HF
Qwopus · Jackrong
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27.3B
Context256K
Smallest10.9 GB
ReasoningTool useVision
OM
Omega Convergence 27B v1.0
Omega · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
UN
Universal Prompt Enhancer 0.8B
Universal · shantanugoel
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
Reasoning
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
RO
Rocinante 12B V1A
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
GGUF
NA
Nanbeige4 3B Thinking 2511
Nanbeige · bartowski
Params3.93B
Context64K
Q4_K_M2.4 GB
Reasoning
TW
TwIL LM3
Twil · NANI-Nithin
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
NE
neo 7b IMat
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
JA
Jan Nano 128k
Jan · bartowski
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Erebus RP 12B Instruct 2608 v1
Gemma · Indexnusrefather
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay

Other quants

Keep browsing