BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B Heretic GGUF
Qwen · xFanexx
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
UN
unlimited ocr
Unlimited · vimalnakrani
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
HE
Hemmingway 1.5
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool use
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
GE
GELab Zero 4B Preview
Gelab · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
Reasoning
UN
Unlimited OCR 2
Unlimited · AtomicChat
Params2.94B
Context128K
Smallest2.0 GB
Vision
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
EM
embeddinggemma-2
Embeddinggemma · AtomicChat
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
RoleplayTool use
TI
Tiny Aya Global
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
HO
K2 Horizon 7B
Horizon · NANI-Nithin
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
GL
GLM 5.3 Flash Uncensored Mixed Quant
GLM · Baekpica
Params564M
Context—
Smallest1.1 GB
GGUF
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
Vision
RU
RusMind.Вспышка 3.5
Rusmind · DICPlay
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
Reasoning
LF
Lfm2-8B-A1B
Lfm · unsloth
Params8.34B
Context125K
Q4_K_M5.0 GB
GGUF
UN
Unlimited OCR 2
Unlimited · RX5950XT
Params2.94B
Context128K
Q4_K_M2.2 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
Vision
PH
Phi 4 Mini Reasoning
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
FA
Falcon-H1-1.5B-Deep-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
OR
Ornith 1.5 35B A3B DFlash
Ornith · na0x2c6
Params386M
Context256K
Smallest0.4 GB
GGUF
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
RoleplayVision
LL
Llama 3.1 8B Stheno v3.4
Llama · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
Roleplay
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
EX
EXAONE-4.0-32B
Exaone · LGAI-EXAONE
Params32B
Context128K
Q4_K_M19.3 GB
GGUF

Other quants

Keep browsing