BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
olmOCR 2 7B 1025
OLMo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LA
Laguna S 2.1 Uncensored APEX
Laguna · SC117
Params118B
Context1024K
Smallest2.2 GB
GGUF
QW
RuadaptQwen3 4B Instruct
Qwen · RefalMachine
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LE
lev
Lev · ggml-org
Params4.2B
Context256K
Q4_K_M3.0 GB
GGUF
QW
Qwen3.5 9B Uncensored
Qwen · bowmanslayer
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · RemySkye
Params129B
Context256K
Smallest35.6 GB
GGUF
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
Coding
QW
Qwen AgentWorld 35B A3B MTP Uncensored APEX
Qwen · SC117
Params447M
Context—
Smallest0.2 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED NVFP4 DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
Vision
PH
Phi 3 mini 4k instruct update2024 07 03 IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
Coding
LI
vllm-d3-lite
Lite · ggml-org
Params1.01B
Context256K
Smallest1.1 GB
Vision
AE
AesCode 32B
Aescode · bartowski
Params32.8B
Context256K
Q4_K_M20.5 GB
CodingVision
DA
Darwin 27B RSI
Darwin · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Reasoning
GR
Granite 4.0 Micro
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
LI
Ling 3.0 tiny abliterated APEX
Ling · SC117
Params7.9B
Context128K
Smallest3.4 GB
GGUF
QW
Qwen3.8 27B Abliterated MTP
Qwen · GCSA-AiLab
Params27B
Context256K
Q4_K_M16.5 GB
Vision
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
GGUF
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
GGUF
OL
ollama3.1
Ollama · xzlinuxmodels
Params8B
Context128K
Smallest6.6 GB
GGUF
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
LF
LFM2.5 VL 3B Uncensored
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
JE
JEV 9B
Jev · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 4B Heretic
Qwen · darrellbest
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
MI
devstral-small-2507
Mistral · mistralai
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
QW
Qwen 35B A3B SignOfFour Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.5 GB
CodingReasoningTool use
QW
Qwen Image 2.1 Uncensored Genesis BF16
Qwen · LuffyTheFox
Params7.12B
Context—
Smallest14.2 GB
GGUF
NA
VisionPsy Nano 460M Flash GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
Vision
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
GGUF

Other quants

Keep browsing