BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
HauhauCS Qwen3.5 9B Uncensored HauhauCS Aggressive
Qwen · CCSSNE
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB
GE
gemma-4-31B
Gemma · ggml-org
Params30.7B
Context256K
Smallest32.6 GB
FA
FairyR1 32B
Fairyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3-VL-Reranker-8B
Qwen · gorse-io
Params7.57B
Context256K
Q4_K_M4.7 GB
GL
Gliese Query Tool 0.6B
Gliese · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwopus3.5 9B Coder
Qwopus · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
QW
Qwen3.8 Flash Next Mixed Quant SSD PLE
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
LL
Dolphin3.0 Llama3.1 8B abliterated 1793043119
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
ComputerScience v1 2B
Qwen · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
WE
WeVisDoc 2B
Wevisdoc · prithivMLmods
Params2.03B
Context256K
Q4_K_M1.3 GB
LL
Meta Llama 3.1 8B
Llama · fedric95
Params8.03B
Context128K
Q4_K_M4.9 GB
LI
Ling 3.0 tiny 256K
Ling · stornic56
Params7.89B
Context256K
Q4_K_M4.9 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · JamePeng2023
Params494M
Context8K
Smallest0.5 GB
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · Vikhrmodels
Params494M
Context32K
Q4_K_M0.4 GB
GE
Gemma 4 31B It Heretic Ara
Gemma · MoonRide
Params30.7B
Context256K
Q4_K_M18.7 GB
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
MA
Mawdistical Mawdistic NightLife 24b
Mawdistic · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 E2B uncensored pruned TextOnly EnglishOnly
Gemma · Handyfff
Params4.01B
Context128K
Q4_K_M2.9 GB
AD
I Added Glitter
Added · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
ST
StandardOne 3B SH
Standardone · StandardThinking
Params3.43B
Context256K
Q4_K_M2.1 GB
IN
JanusCoder 8B
InternLM · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
NetaYume Lumina Image 2.0
Netayume · Immac
Params2.61B
Context—
Q4_K_M2.1 GB
LI
jayyun98/Ling-3.0-Tiny-DSpark
Ling · StefanoBalocco
Params274M
Context128K
Smallest0.1 GB
TI
TildeOpen 30b
Tildeopen · bartowski
Params30.7B
Context64K
Q4_K_M18.5 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M15.0 GB
QW
Qwen3Guard-Gen-8B
Qwen · Mungert
Params8.19B
Context32K
Q4_K_M5.1 GB
LT
LTX 2.3
Ltx · MakiAi
Params21B
Context—
Q4_K_M14.3 GB
ME
MedPsy 4B
Medpsy · qvac
Params4.41B
Context256K
Q4_K_M2.7 GB
LL
grok oss Revenant 8B
Llama · c4tdr0ut
Params8.03B
Context128K
Smallest5.7 GB