BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
ME
Mellum2-12B-A2.5B-Instruct
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
MA
maya1
Maya · Mungert
Params3.3B
Context128K
Q4_K_M2.2 GB
QW
Qwen3-VL-Reranker-2B
Qwen · gorse-io
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3-14B-abliterated
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.2 GB
DE
FuseO1 DeepSeekR1 QwQ 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LT
LTX 2.3
Ltx · wuhaixie
Params21B
Context—
Q4_K_M14.2 GB
MI
Devstral-Small-2505
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen Image 2.1 Uncensored
Qwen · laazuri
Params7.12B
Context—
Q4_K_M4.6 GB
KA
kani-tts-400m-en
Kani · Mungert
Params370M
Context125K
Q4_K_M0.3 GB
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
LF
LFM2.5 VL 450M
Lfm · ZuzeTt
Params354M
Context125K
Q4_K_M0.2 GB
NO
Noema 1.5 4B Deep
Noema · NoemaAI-labs
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
LFM2.5 2.6B Uncensored
Lfm · zaakirio
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen3.5-4B
Qwen · Mungert
Params4.21B
Context256K
Q4_K_M2.8 GB
QW
Qwen3 4B Instruct 2507
Qwen · bullerwins
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 9B
Qwen · prithivMLmods
Params8.95B
Context256K
Smallest9.5 GB
GE
google_gemma-3-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
OR
Orbit 3.2 Nano
Orbit · bartowski
Params2.7B
Context128K
Q4_K_M1.8 GB
GE
Gemma 4 12B It Heretic Custom
Gemma · MoonRide
Params11.9B
Context256K
Q4_K_M7.4 GB
LF
lfm3 vld 2b
Lfm · webbrain-one
Params1.99B
Context125K
Q4_K_M1.2 GB
FL
fluxunchained dev
Fluxunchained · mhnakif
Params11.9B
Context—
Q4_K_M6.9 GB
GE
Ultragemma4 12b Heretic Uncensored
Gemma · prithivMLmods
Params11.9B
Context128K
Q4_K_M7.4 GB
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · Ex0bit
Params31.6B
Context1024K
Smallest18.2 GB
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
QW
Qwen3 4B Thinking 2507 Gemini 2.5 Flash Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.6-35B-A3B
Qwen · Mspanz88
Params34.7B
Context256K
Q4_K_M22.1 GB
GE
humanizer-12b
Gemma · DeepDive404-2
Params11.9B
Context256K
Q4_K_M7.6 GB
GE
humanizer-12b
Gemma · LucidCC13105
Params11.9B
Context256K
Q4_K_M7.6 GB
DA
Darwin 180B RSI Mixed Quant
Darwin · Baekpica
Params129B
Context256K
Smallest83.3 GB
GE
humanizer-12b
Gemma · Joseph1234222
Params11.9B
Context256K
Q4_K_M7.6 GB