BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 4B Runner ToolUse Q4 K M
Qwen · Joakimpalm-Zen
Params17M
Context—
Q4_K_M0.1 GB
GGUF
SU
Survivor v1 2B
Survivor · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
JA
Jais-3-0.9B
Jais · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
GE
Gemma-3-1B-It
Gemma · tripolskypetr
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Scarlett Opus Hf
Qwopus · Linux4life
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
IM
Z Image
Image · vantagewithai
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
TA
Tadpole 0.8B
Tadpole · Srinjoy99
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
UN
UnslopNemo 12B v2
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · legraphista
Params1.48B
Context128K
Smallest0.5 GB
Coding
EX
K-EXAONE-236B-A23B
Exaone · LGAI-EXAONE
Params237B
Context256K
Q4_K_M143.5 GB
ReasoningTool use
OP
Oprius 3.0 1.1B
Oprius · bartowski
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GGUF
QW
CreativeWriter v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Hornybot-RP-Mara
Qwen · axiomofmind
Params8.95B
Context256K
Smallest7.4 GB
ReasoningRoleplayTool use
QW
Qwen Image Edit 2511 diffuser
Qwen · smthem
Params20.4B
Context—
Smallest11.5 GB
GGUF
BO
Boris 125M Instruct
Boris · opencerebral
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen3.5 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GR
Granite 4.1 3B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
IN
Internvl3-38B
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool useVision
HO
K2-Horizon-3.7B
Horizon · emperorofrome
Params5.06B
Context512K
Q4_K_M3.2 GB
CodingReasoningTool use
QW
LFM2.5 2.6B
Qwen · arbonquants
Params2.7B
Context128K
Smallest1.5 GB
ReasoningTool use
QW
Qwen3.8-27B
Qwen · Sh200126
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.6 9B Heretic Uncensored Thinking Sweet Madness
Qwen · filvyb
Params8.63B
Context256K
Smallest17.3 GB
ReasoningRoleplayTool use
LL
CleverBoi Llama 3.1 8B Instruct
Llama · theprint
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SU
SU 01
axi0mX
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
DE
Decision 2.0 Nox 4B
Decision · vllm-sr
Params4.21B
Context16K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 4B Opus Distilled Heretic Thinking Multistage SFT v1.0
Qwen · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
GE
Gemma 4 E2B It
Gemma · giladgd
Params4.65B
Context128K
Q4_K_M3.5 GB
ReasoningTool useVision
TR
Trouper 12B
Trouper · DakkaWolf
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
QW
qwen3-vl-8B-nsfw-caption-v4
Qwen · HDiffusion
Params8.19B
Context256K
Smallest5.9 GB
Tool useVision

Other quants

Keep browsing