BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.5-4B
Qwen · Mazaxaka777
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
Ministral 3 3B Instruct 2512 roleplay tuned ERP tolerant
Mistral · Indexnusrefather
Params3.43B
Context256K
Q4_K_M2.1 GB
AU
MS3.2 Austral Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 Uncensored Aggressive
Qwen · tripolskypetr
Params122B
Context256K
Q4_K_M1.3 GB
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
GR
Granite Speech 5.0 470M TurboCTC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
GE
Gemma 4 31B It
Gemma · giladgd
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
SK
Skyfall 31B v4
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
XX
T5 V1_1 Xxl
Xxl · chatpig
Params4.76B
Context512
Q4_K_M2.9 GB
QW
Qwen3-1.7B
Qwen · XythicK
Params1.72B
Context40K
Q4_K_M1.1 GB
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
TO
ToriiGate 0.5
Toriigate · SleepVeryHard
Params4.84B
Context—
Smallest0.0 GB
ON
OneJev1.5 4B
Onejev · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB
QW
Qwen3.5-4B
Qwen · cmp-nct
Params4.21B
Context256K
Q4_K_M2.7 GB
IN
JanusCoder 14B
InternLM · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma 4 31B IT NVFP4 Src
Gemma · LibertAIDAI
Params30.7B
Context256K
Q4_K_M17.8 GB
UN
UniPercept
Unipercept · AX1Y2JP
Params7.6B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 31B Humanlike Chat
Gemma · LessThanThreeAI
Params30.7B
Context256K
Q4_K_M18.7 GB
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
AN
AniSora v3
Anisora · woctordho
Params16.4B
Context—
Q4_K_M10.9 GB
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB