BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3.1 8B Instruct Bnb 4bit
Llama · 0xroyce
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
VI
mythos fast
Vibethinker · Shadow0482
Params3.1B
Context128K
Q4_K_M1.9 GB
Tool use
RN
Rnj-1-Instruct
Rnj · unsloth
Params8.3B
Context32K
Q4_K_M5.1 GB
GGUF
QW
Qwen3.8 Flash Coder 85GB BF16
Qwen · IsValorum
Params42.6B
Context256K
Smallest85.3 GB
CodingReasoning
AU
AutoCoder
Autocoder · legraphista
Params33.3B
Context16K
Smallest7.2 GB
Coding
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
LL
Cogito-V2-Preview-Llama-70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB
GGUF
PA
MS3.2 PaintedFantasy v2 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
SK
Skywork OR1 32B
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
Tool useVision
OP
OpenClaude 1.7B Merged
Openclaude · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
Reasoning
MA
MagenticBrain
Magenticbrain · devehz
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
IN
Internvl3-2B
Internvl · unsloth
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingVision
RU
RusMind 4.5.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
QW
ThinkingCap Qwen3.6 27B MTP
Qwen · protoLabsAI
Params461M
Context256K
Q4_K_M15.7 GB
ReasoningVision
QW
Qwen3.5 9B
Qwen · Zirconium419122
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
CY
Cydonia 22B v1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
AG
Agentflow Planner 7b
Agentflow · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Andy 4.2 Air
Qwen · Mindcraft-CE
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
QwenGram-0.8B REAL-15M R=1
Qwen · Ninnix96
Params783M
Context256K
Q4_K_M0.6 GB
GGUF
HU
hunyuan
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
CO
Chromadb Context 1
Context · ryancook
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
MI
Ministral 3 14B Reasoning 2512 heretic
Mistral · coder3101
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
Vision
AG
Agents-A1-4B-Heretic-ARA-Refusals0-Q4_K_M
Agents · NullpoLab
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
CH
Chandra
Chandra · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision

Other quants

Keep browsing