BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma-4-E2B-it
Gemma · ggml-org
Params4.65B
Context128K
Smallest0.1 GB
Vision
QW
Qwen3-ASR 0.6B
Qwen · handy-computer
Params782M
Context—
Q4_K_M0.6 GB
GGUF
OR
Ornith 1.5 122B
Ornith · unsloth
Params125B
Context256K
Smallest40.4 GB
Vision
QW
Holo 3.1 35B A3B
Qwen · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
Vision
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · unsloth
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
IM
Z Image
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
QW
Qwen3-Coder-Next
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
Coding
QW
Qwen3-0.6B
Qwen · unsloth
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 4B
Qwen · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
AC
audio.cpp
Acestep · CaptainArni
Params—
Context—
Smallest10.7 GB
GGUF
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
GGUF
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
GE
gemma-4-E4B-it
Gemma · ggml-org
Params7.5B
Context128K
Smallest0.1 GB
Vision
DE
DeepSeek V4 Flash 0731
DeepSeek · unsloth
Params284B
Context—
Smallest10.9 GB
GGUF
AU
Audio Flamingo
Audio · audio-cpp
Params—
Context—
Smallest5.5 GB
GGUF
TA
UI-TARS-1.5-7B
Tars · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
GGUF
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GGUF
GE
gemma 4 E4B it qat
Gemma · unsloth
Params93M
Context128K
Smallest0.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · ggml-org
Params1.9B
Context256K
Q4_K_M20.4 GB
Vision
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
SN
snowflake arctic embed m v1.5
Snowflake · Snowflake
Params109M
Context512
Smallest0.1 GB
Embedding
WA
Wan2.1 14B VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
GGUF
QW
Qwen3.5 4B
Qwen · bartowski
Params4.33B
Context256K
Q4_K_M3.0 GB
Vision
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
GR
Granite 4.2 3B BE
Granite · taronaeo
Params3.66B
Context—
Q4_K_M2.2 GB
ReasoningTool use

Other quants

Keep browsing