BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
AG
Huihui Agents A1 Abliterated
Agents · huihui-ai
Params34.7B
Context256K
Smallest21.2 GB
ME
Medgemma-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 14B Abliterated
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-Next-80B-A3B-Thinking
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · huihui-ai
Params284B
Context—
Smallest135.3 GB
GE
Gemma 4 31B It
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
MI
Mimo-V2-Flash
Mimo · unsloth
Params310B
Context256K
Q4_K_M186.8 GB
WA
wan 1.3b
Wan · calcuis
Params127M
Context—
Q4_K_M1.0 GB
QW
Qwen2.5-VL-3B-Instruct
Qwen · Mungert
Params3.1B
Context125K
Q4_K_M1.9 GB
QW
Qwen3VL 8B Uncensored HauhauCS Aggressive
Qwen · HauhauCS
Params8.2B
Context256K
Q4_K_M5.0 GB
GE
Huihui gemma 4 26B A4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params25.2B
Context128K
Smallest0.9 GB
LF
LFM2.5-VL-3B
Lfm · LiquidAI
Params2.7B
Context32K
Q4_K_M1.7 GB
HO
K2 Horizon 7B
Horizon · IFM
Params9B
Context512K
Q4_K_M5.6 GB
QW
Qwen3.5 122b A10B Opus Reasoning Merged
Qwen · timteh673
Params122B
Context256K
Q4_K_M74.2 GB
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
LF
LFM2.5 VL 1.6B
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.8 Flash Next FP4 Local Strata
Qwen · hardhant
Params51.2B
Context—
Smallest1.3 GB
CL
Clef
Clef · ggml-org
Params27B
Context256K
Q4_K_M19.5 GB
QW
Qwen3 8B Abliterated
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
LFM2.5 8B A1B
Qwen · DavidAU
Params8.47B
Context125K
Smallest4.6 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MX
mxbai embed xsmall v1
Mxbai · mixedbread-ai
Params24M
Context4K
Smallest0.0 GB
QW
Qwen3.5 0.8B
Qwen · bartowski
Params773M
Context256K
Q4_K_M0.6 GB
QW
Qwen3.5 9B Ultra Uncensored Heretic
Qwen · llmfan46
Params8.95B
Context256K
Q4_K_M5.5 GB
BR
Breeze-ASR-25
Breeze · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GE
Huihui gemma 4 31B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params30.7B
Context128K
Smallest1.0 GB
MI
Voxtral Mini 3B
Mistral · handy-computer
Params4.7B
Context—
Q4_K_M3.0 GB
QW
Canary-Qwen 2.5B
Qwen · handy-computer
Params2.53B
Context—
Q4_K_M1.7 GB
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB