BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
MI
Mistral 7B Instruct v0.2 llamafile
Mistral · mozilla-ai
Params7.24B
Context32K
Smallest14.5 GB
LF
LFM2.5-1.2B-Thinking
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Q4_K_M21.5 GB
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
MI
MiMo-V2.6-Flash-RL
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
TE
Tess 4.5 27B
Tess · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
LE
lemer
Lemer · lthn
Params4.65B
Context128K
Q4_K_M3.4 GB
OM
D1 Omni 2B
Omni · LiquidAI
Params1.73B
Context125K
Smallest1.8 GB
FL
FLUX.1 Kontext dev
Flux · bullerwins
Params11.9B
Context—
Q4_K_M6.9 GB
ST
StandardOne 8B
Standardone · StandardThinking
Params8.49B
Context256K
Q4_K_M5.2 GB
MA
MS3.2 24B Magnum Diamond
Magnum · Doctor-Shotgun
Params23.6B
Context128K
Q4_K_M14.3 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · bartowski
Params37.4B
Context512K
Q4_K_M22.7 GB
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
JU
Julia-1
Julia · ggml-org
Params144M
Context8K
Smallest0.2 GB
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
SK
Skyfall 31B v4.2
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.3 GB
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
FL
FLUX 3 Image Klein pup Uncensored
Flux · AtomicChat
Params8.95B
Context256K
Smallest0.0 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB