BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GE
Gemma 4 E4B It Uncensored MAX
Gemma · prithivMLmods
Params7.5B
Context128K
Smallest8.0 GB
QW
dhyield rp 14b v1 multi bilingual
Qwen · dhyield
Params14.8B
Context32K
Smallest10.5 GB
CO
Cosmic Lightning
Cosmic · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
QW
Qwen3VL Uncensored Aggressive
Qwen · tripolskypetr
Params8.2B
Context256K
Q4_K_M5.0 GB
QW
qwen35 heretic 9b
Qwen · brenzodotdev
Params8.95B
Context256K
Q4_K_M6.8 GB
GE
Gemma 4 E2B It Saber
Gemma · DJLougen
Params4.63B
Context128K
Q4_K_M3.4 GB
QW
Karlsen Chat 27B abliterated
Qwen · karlsencoin
Params27.3B
Context256K
Q4_K_M16.6 GB
JA
Jan v3 4B Base Instruct
Jan · bartowski
Params4.41B
Context256K
Q4_K_M2.7 GB
GE
Gemma 4 RUST CODER 12B
Gemma · MassivDash
Params11.9B
Context256K
Q4_K_M7.4 GB
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
QW
Qwen3 4B Thinking 2507 MiniMax M2.1 Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB
GR
Granite 4.2 8b
Granite · nile-academy
Params8.79B
Context128K
Q4_K_M5.3 GB
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
Gemma 4 31B Fable 5 Agent
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen Image 2.1 Uncensored
Qwen · kkguku
Params7.12B
Context—
Q4_K_M4.6 GB
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GR
Granite-3.3-8B-Instruct
Granite · unsloth
Params8.17B
Context128K
Q4_K_M4.9 GB
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Opus Distill v2
Qwen · barozp
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
QwenPaw Flash 9B
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
OM
Omni Edu 9B
Omni · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
JA
Jan v1 4B
Jan · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB