BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
Mario Html v2 9B
Mario · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool useVision
HO
K2 Horizon 32B
Horizon · IFM
Params34.8B
Context512K
Q4_K_M21.1 GB
GGUF
ED
EdgeRock 4B
Edgerock · hkust-aaron
Params4.58B
Context256K
Q4_K_M2.9 GB
Coding
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
GGUF
CL
Clef Flash
Clef · taurusduan
Params9.1B
Context256K
Q4_K_M6.0 GB
CodingVision
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
GGUF
TR
Trinity Nano Preview
Trinity · arcee-ai
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Bolt-E4B-DFlash
Nemotron · ggml-org
Params7.52B
Context128K
Smallest0.6 GB
ReasoningTool use
QW
Qwen Image 2.1 Uncensored
Qwen · daddysteven
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · LGAI-EXAONE
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Qwopus3.8 27B Flash
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
ReasoningVision
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
Coding
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
ZE
zed industries zeta 2
Zeta · bartowski
Params8.25B
Context32K
Q4_K_M5.2 GB
GGUF
OL
open r1 OlympicCoder 7B
Olympiccoder · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoning
QW
MARTHA LXVII.8B QWEN 3.5 3.6 prune 9b 3.6 base
Qwen · ZERO-POINT-AI
Params8.1B
Context256K
Q4_K_M5.1 GB
RoleplayVision
QW
Qwen3.5 40B Claude 4.5 Opus High Reasoning Thinking uncensored heretic
Qwen · llmfan46
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen3 2507 4B Instruct Haiku 4.5 Merged
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
RoleplayTool use
SE
Seed OSS 36B Instruct
Seed · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
QW
Qwen3.6 35B A3B DFlash2
Qwen · aminya
Params526M
Context256K
Q4_K_M0.3 GB
GGUF
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Tool useVision
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
OV
OvisOCR2
Ovisocr · MDfox
Params752M
Context256K
Q4_K_M0.5 GB
Vision

Other quants

Keep browsing