BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
SP
Spark X2.6 4B
Spark · abenzerps
Params4.11B
Context1024K
Q4_K_M2.6 GB
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3.8 Flash Next Q8 0 Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
D1
d1 3B
NANI-Nithin
Params2.7B
Context32K
Q4_K_M1.7 GB
DA
Dans PersonalityEngine V1.3.0 24b
Dans · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GR
Granite 4.0 1b
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3-Coder-Next
Qwen · Mungert
Params79.7B
Context256K
Q4_K_M49.2 GB
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama 3.3 8B Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
DeepSeek V4 Pro Qwen3.5 4B MTP Public 20260801 HF
Qwen · Jackrong
Params4.33B
Context256K
Q4_K_M2.8 GB
TE
Tev1 4B Experimental
Tev · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
QW
Mica v0.5 4B
Qwen · sky7350
Params4.21B
Context256K
Smallest2.5 GB
AM
amalia-llm/AMALIA-9B-0626-DPO
Amalia · layerx-labs
Params9.15B
Context32K
Q4_K_M5.6 GB
CA
Carnice-V2-27B
Carnice · kai-os
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · xrachelburns
Params27.3B
Context256K
Q4_K_M16.6 GB
HU
Hunyuan 7B Instruct
Hunyuan · bartowski
Params7.5B
Context256K
Q4_K_M4.6 GB
MI
Mimo-V2.5-Pro
Mimo · unsloth
Params1020B
Context1024K
Q4_K_M629.6 GB
LA
Laguna-XS-2.1
Laguna · ggml-org
Params33.4B
Context256K
Q4_K_M19.6 GB
UN
UnslopNemo 12B v4.1
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB