BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
Vision
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GGUF
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3 4B Instruct 2507
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
Vision
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
Embedding
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · bartowski
Params108B
Context10240K
Q4_K_M67.5 GB
GGUF
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
Vision
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
CY
Huihui CyberStrike OffSec 35B Abliterated
Cyberstrike · huihui-ai
Params35.5B
Context256K
Smallest21.7 GB
Tool useVision
KI
kitten tts2
Kitten · dignome
Params—
Context—
Smallest1.4 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
SO
Soprano 1.1 80M
Soprano · WalkingCat
Params80M
Context—
Smallest0.1 GB
GGUF
AC
ace step 1.5 gguf merge models
Ace · scragnog
Params5B
Context32K
Q4_K_M3.0 GB
GGUF
GE
gemma 4 E4B it qat mobile
Gemma · unsloth
Params7.46B
Context128K
Smallest0.1 GB
Vision
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
NE
Nemotron 3 Diarization
Nemotron · audio-cpp
Params99M
Context—
Smallest0.1 GB
GGUF
QW
Ternary-Bonsai-2-4B
Qwen · prism-ml
Params782M
Context256K
Smallest0.9 GB
Vision
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3.8-Flash-Next
Qwen · ggml-org
Params177B
Context256K
Smallest0.4 GB
Vision
DE
DeepSeek V4.1 Flash 1017 Vision Encoder
DeepSeek · kyuz0
Params755B
Context—
Smallest1.0 GB
GGUF
QW
Qwen3 Omni 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
DE
DeepSeek V4.1 Flash UNCENSORED DwarfStar Q2
DeepSeek · pyrodog
Params490M
Context—
Smallest1.0 GB
GGUF

Other quants

Keep browsing