BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Ingot 27B DFlash2
Qwen · dendriteholdings
Params1.92B
Context256K
Smallest2.1 GB
ReasoningTool use
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
ReasoningVision
LL
Meta Llama 3.1 8B Instruct
Llama · modularai
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ReasoningVision
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
Coding
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest4.0 GB
GGUF
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
Reasoning
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
ReasoningTool useVision
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB
GGUF
LI
LightOnOCR 3 1B
Lightonocr · prithivMLmods
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
OL
Olmo-3-7B-Instruct
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
GR
Granite-4.0-350M
Granite · unsloth
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GGUF
QW
Qwen3.6 27B Uncensored Heretic v2
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · CISCai
Params32.8B
Context32K
Smallest7.3 GB
Coding
QW
Qwen2.5 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
ME
Medgemma 27b It
Medgemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision

Other quants

Keep browsing