BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
GL
GLM 5.3 Flash UNCENSORED mlx oQ8e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CO
Computer 10
Computer · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
ME
Mellum2.1 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.8 GB
D1
d1 2B
LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
PH
Phi-4-Mini-Reasoning
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
LT
LTX 2.5 Comfy
Ltx · agosh
Params21B
Context—
Smallest7.3 GB
OR
Ornith 1.5 122B
Ornith · bartowski
Params125B
Context256K
Q4_K_M78.9 GB
LI
LightOnOCR 3 4B
Lightonocr · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
decider 4b
Decider · Mapika
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
RO
TheDrummer Rocinante XL 16B v1
Rocinante · bartowski
Params16.1B
Context128K
Q4_K_M10.1 GB
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
OR
Ornith 1.5 9b Mtp
Ornith · protoLabsAI
Params456M
Context256K
Q4_K_M5.8 GB
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
NE
NeoHorse-1-4B
Neohorse · TokenRhythm
Params4.21B
Context256K
Q4_K_M2.7 GB