BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
VideoGuard Qwen3.5 9B Safety RL Uncensored
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen3 14B Ft Limo
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
CodingReasoning
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
RI
Ring Mini 2.0
Ring · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
GL
Glistening Gem 31B v2.0
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GGUF
QW
GrayLine Qwen3 8B
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
RW
rwkv 6 world 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
MA
Magidonia 24B v4.2.0
Magidonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · ggml-org
Params3.43B
Context128K
Q4_K_M2.6 GB
Vision
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
GGUF
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
PA
Pantheon Rp 1.6 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
BigBubba Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
JA
Jan-Nano
Jan · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
QW
Qwen3 VL 32B Thinking
Qwen · bartowski
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision
SM
SmolVLM2 2.2B Instruct Agentic GUI
Smolvlm · bartowski
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
WA
wan 1.3b
Wan · bykhan
Params127M
Context—
Q4_K_M1.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · kingjones777
Params3.88B
Context256K
Q4_K_M2.8 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
GGUF
GE
anon 1b
Gemma · scratchyone
Params1B
Context32K
Smallest2.0 GB
GGUF
GE
Gemma 4 31B It Claude Opus Distill
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
QW
Qwen3-Vl-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
Vision
SH
OS Shepherd 9B
Shepherd · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GE
gemma 4 26B A4B it ara abliterated
Gemma · jenerallee78
Params25.2B
Context256K
Smallest20.6 GB
Vision
LF
LFM2 2.6B Transcript
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision

Other quants

Keep browsing