BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Strand-Rust-Coder-14B-v1
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.3 GB
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
NE
neo_7b_instruct_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
YU
YuE2 3B Ruach Studio IRA Merge
Yue · goldhub
Params3.58B
Context—
Smallest2.9 GB
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3-8B
Qwen · ggml-org
Params8.19B
Context40K
Smallest1.1 GB
DA
Darwin 4B Chimera
Darwin · bartowski
Params4B
Context40K
Q4_K_M2.6 GB
QW
ThinkingCap Qwen3.8 Flash-Next
Qwen · bottlecapai
Params180B
Context256K
Q4_K_M113.2 GB
ZD
ZDTaichu5.0 9B
Zdtaichu · TaichuAI
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
DW
Dwight 4b
Dwight · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
DE
Qwen3 8B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
LF
LFM2.5 8B A1B Uncensored
Lfm · zaakirio
Params8.47B
Context125K
Q4_K_M5.2 GB
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
DI
DiscoveryRSI 27B
Discoveryrsi · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
UM
Umt5 Xxl
Umt · chatpig
Params5.68B
Context512
Q4_K_M3.7 GB
WA
wan s2v
Wan · calcuis
Params16.3B
Context—
Q4_K_M13.9 GB
ER
ERNIE Image
Ernie · unsloth
Params8.03B
Context—
Q4_K_M5.0 GB
AP
Apertus 8B Instruct 2509
Apertus · bartowski
Params8.05B
Context64K
Q4_K_M5.1 GB
AP
Apriel 1.6 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
GE
Gemma-4-E2B-It
Gemma · mnsims1024
Params4.65B
Context128K
Q4_K_M3.1 GB
GE
humanizer-12b
Gemma · npario
Params11.9B
Context256K
Q4_K_M7.6 GB