BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M18.0 GB
ReasoningTool useVision
VA
Valkyrie 49B v2.1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
CL
CLM v0.1 8B
Clm · czl
Params8.19B
Context40K
Q4_K_M5.0 GB
Embedding
QW
_merged_Crow 4B Opus 4.6 Distill Heretic_Qwen3.5
Qwen · Crownelius
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningVision
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
QW
Qwen2.5-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
QW
Josiefied Qwen3 14B Abliterated v3
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
GL
GLM 5.1
GLM · unsloth
Params754B
Context198K
Q4_K_M464.5 GB
GGUF
SM
nisten/Biggie-SmoLlm-0.15B-Base
SmolLM · nisten
Params152M
Context2K
Smallest0.2 GB
GGUF
QW
Jan-v2-VL-high
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
ReasoningVision
LO
LongCat Image
Longcat · vantagewithai
Params6.27B
Context—
Q4_K_M3.7 GB
GGUF
JA
AI21 Jamba2 Mini Ultra Uncensored Heretic
Jamba · llmfan46
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma 4 e2b yemeni arabic assistant
Gemma · yemeni-ai-lab
Params4.63B
Context128K
Q4_K_M3.4 GB
Vision
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
ReasoningTool use
ED
vllm-d3-edge
Edge · ggml-org
Params748M
Context256K
Smallest0.8 GB
Vision
DE
Decision 2.0 Vega 27B
Decision · vllm-sr
Params25.6B
Context32K
Q4_K_M15.9 GB
GGUF
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
ReasoningTool use
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
CodingTool useVision
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
Coding
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · zugquants
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
Coding
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
GGUF
DE
Q3 30B A3B Designant
Designant · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
ReasoningRoleplay

Other quants

Keep browsing