BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B Abliterated
Qwen · Grimxlock
Params26.9B
Context256K
Q4_K_M16.5 GB
HI
HiDream I1 Fast
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
RU
RusMind 4.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 4.1 30b
Granite · bartowski
Params28.9B
Context128K
Q4_K_M17.8 GB
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
MA
Magistry 24B v1.1
Magistry · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
RU
RusMind 4.5.1 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
MI
MiniCPM5 2B
MiniCPM · NANI-Nithin
Params2.52B
Context128K
Q4_K_M1.6 GB
GE
Amoral Fallen Omega Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
JP
jpt 9b
Jpt · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
VE
LoopCoder
Veriloop · rodrigoramosrs
Params27.3B
Context256K
Q4_K_M16.8 GB
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen3.5 9B Neo
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3.8 27B DSpark
Qwen · erlidev
Params1.36B
Context256K
Smallest1.5 GB
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
QW
Qwen3.6 35B A3B NVFP4 Src
Qwen · LibertAIDAI
Params34.7B
Context256K
Q4_K_M19.8 GB
JA
AI21 Jamba2 Mini
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
QW
ChaoticNeutrals Very Berry Qwen2 7B
Qwen · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · llmfan46
Params26.9B
Context256K
Q4_K_M16.2 GB
ON
OneJev 4B
Onejev · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB