BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NE
Nex N2 Mini
Nex · SC117
Params34.7B
Context256K
Smallest16.5 GB
CH
Chaifighter-20B-v2
Chaifighter · backyardai
Params19.5B
Context4K
Q4_K_M11.7 GB
QW
Qwen3-Coder-Next
Qwen · robertdemottojr83
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
Gliese Qwen3.5 0.8B Abliterated Caption
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
Swift1.5 Qwen3.8 Flash Next Mixed Quant
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
GR
Granite 4.0 Micro Base
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
MI
MiniCPM V 4.6 Thinking Abliterated MAX
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
TR
Translategemma 4b It
Translategemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E2B It
Gemma · axteam
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3 Embedding Giga Embeddings 0826 3B
Qwen · ai-babai
Params3.15B
Context8K
Q4_K_M2.0 GB
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · qwp4w3hyb
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
FO
ReadyArt Forgotten Safeword 24B 3.6
Forgotten · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Ternary-Bonsai-2-4B
Qwen · suryatmodulus
Params782M
Context256K
Smallest0.9 GB
GE
Gemma 4 E4B It Qat Heretic_Decensored
Gemma · prithivMLmods
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · ScottzillaSystems
Params11.9B
Context128K
Q4_K_M7.4 GB
AP
Apollo V0.1 4B Thinking
Apollo · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Gemma 4 12B It Jbliterated V12W P6
Gemma · ApolloRaines
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 27B Fable Distill Heretic ara
Qwen · armand0e
Params27.3B
Context256K
Q4_K_M17.4 GB
BR
Breeze TTS 2
Breeze · npario
Params—
Context—
Smallest4.3 GB
FA
FairyR1 14B Preview
Fairyr · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
phi-3-mini-4k-june-symbolic-sentiment-analysis-july-03-2024-2-epoch
Phi · seandearnaley
Params3.82B
Context4K
Q4_K_M2.3 GB
MI
Ministrations 8B v1
Ministrations · TheDrummer
Params8.02B
Context32K
Q4_K_M4.9 GB
AG
Agents-A1-4B-Heretic-ARA-Refusals8-Q4_K_M
Agents · NullpoLab
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen Image 2.1 Uncensored
Qwen · feeday
Params7.12B
Context—
Q4_K_M4.6 GB
QW
Qwen3.5 397B A17B Opus 4.6 Reasoning Uncensored
Qwen · timteh673
Params396B
Context256K
Q4_K_M240.6 GB
GE
Huihui gemma 4 31B it qat abliterated MTP NVFP4
Gemma · RemySkye
Params30.7B
Context128K
Smallest0.5 GB