BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
PA
PaddleOCR-VL-1.6
Paddleocr · Mungert
Params467M
Context128K
Q4_K_M0.4 GB
PA
Pantheon Reasoning 27B
Pantheon · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
HU
Hunyuan-A13B-Instruct
Hunyuan · unsloth
Params80B
Context256K
Q4_K_M48.8 GB
HU
Hunyuan 0.5B Instruct
Hunyuan · bartowski
Params539M
Context256K
Q4_K_M0.4 GB
QW
Qwen3-4B-abliterated
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
FI
SUFE AIFLM Lab Fin R1
Fin · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
TE
Terminal RSI 27B
Terminal · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
LI
LightOnOCR 3 0.8B
Lightonocr · NANI-Nithin
Params752M
Context256K
Q4_K_M0.5 GB
PH
phi-4-mini-instruct
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
HO
Holo 3.1 4B
Holo · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB
QW
Himeros V2 27B
Qwen · Skttttt
Params27B
Context256K
Q4_K_M16.5 GB
HO
K2 Horizon 3.7B
Horizon · NANI-Nithin
Params5.06B
Context512K
Q4_K_M3.2 GB
GR
Granite 4.0 H 1b
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
MI
Mistral Small 4 119B Uncensored
Mistral · timteh673
Params119B
Context1024K
Q4_K_M72.2 GB
GL
GLM 4.7 Flash Claude Opus 4.5 High Reasoning Distill
GLM · TeichAI
Params30B
Context198K
Q4_K_M18.1 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
MI
Mimo-Vl-7B-Rl
Mimo · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
QW
Qwen3.5 4B
Qwen · dahara1
Params4.21B
Context256K
Q4_K_M2.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · bartowski
Params7.52B
Context64K
Q4_K_M5.2 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · AtomicChat
Params24B
Context128K
Q4_K_M15.4 GB
GE
Gemma 4 E2B It Uncensored MAX
Gemma · prithivMLmods
Params4.65B
Context128K
Smallest5.0 GB
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
UN
Unlimited OCR
Unlimited · sabafallah
Params2.93B
Context—
Q4_K_M2.0 GB