BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
US
UserRepGen 4B
Userrepgen · bartowski
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
OM
OmniCoder 9B
Omnicoder · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Coding
QW
Qwen3 VL 8B Thinking
Qwen · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
RU
RusMind.Моментум 3.5.1
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningVision
GE
Gemma 4 26B A4B It Claude Opus Distill v2
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
GGUF
OR
Cyber Ornith 1.5 9B OBLITERATED
Ornith · DuoNeural
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
open text detector qwen36 35b a3b oct10
Qwen · woog
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3-8B-abliterated
Qwen · Mungert
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · Anbeeld
Params386M
Context256K
Q4_K_M0.2 GB
CodingEmbedding
OR
Ornith 1.0 9B heretic MTP
Ornith · SC117
Params456M
Context256K
Q4_K_M5.8 GB
ReasoningVision
GR
Huihui Granite 4.1 3b Abliterated
Granite · huihui-ai
Params3.4B
Context128K
Smallest6.8 GB
GGUF
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingReasoning
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningTool useVision
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
Reasoning
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
GGUF
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
Reasoning
MI
snap1 2B
MiniCPM · logitlab
Params2.52B
Context128K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
LI
LightOnOCR 2 1B
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
LI
LightOnOCR 2 1B Ocr Soup
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision

Other quants

Keep browsing