BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
Reasoning
PA
MS3.2 PaintedFantasy v4.1 24B
Paintedfantasy · zerofata
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
CodingReasoning
HO
K2 Horizon 0.9B
Horizon · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
KO
Huihui Kolibri 1 BF16 Abliterated
Kolibri · huihui-ai
Params78B
Context256K
Q4_K_M47.5 GB
Reasoning
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
GGUF
GR
granite 4.0 1b speech
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
AP
35B A3B
Apus · apus-ailab
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
SM
Smollm3-3B
SmolLM · unsloth
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
QW
Qwen3 ASR 1.7B
Qwen · unslothai
Params2.03B
Context64K
Smallest2.2 GB
Vision
AL
Source Hf Aliceai T5 35b A0.6B
Aliceai · ngquocvinh
Params34.6B
Context128K
Q4_K_M21.0 GB
Coding
GL
GLM 5.3 Flash UNCENSORED mlx oQ4e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
Vision
QW
Qwen3 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
OP
OpenJev
Openjev · ggml-org
Params27B
Context256K
Q4_K_M19.4 GB
Vision
OC
Occamy 1.0 Abliterated
Occamy · SC117
Params34.7B
Context256K
Q4_K_M16.5 GB
ReasoningVision
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
GGUF
OM
d1-omni-600M
Omni · LiquidAI
Params381M
Context125K
Smallest0.4 GB
Vision
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
OM
OmniCoder 9B
Omnicoder · Tesslate
Params8.95B
Context256K
Q4_K_M5.7 GB
Coding
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
GGUF
OR
Huihui Ornith 1.0 9B abliterated MTP
Ornith · huihui-ai
Params2.28B
Context256K
Q4_K_M6.9 GB
GGUF
GR
Granite Speech 4.1 2B Plus
Granite · handy-computer
Params2.11B
Context—
Q4_K_M1.5 GB
GGUF
XI
Xiaomi OCR 0
Xiaomi · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Flashnext Abliterated
Qwen · windowsxp811203
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
GGUF
GR
Granite 4.1 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay

Other quants

Keep browsing