F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
QW
Qwen3Vl 4b Thinking
Qwen · Qwen
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 Vl 4b Heretic
Qwen · DreamFast
Params4B
Context256K
Q4_K_M2.5 GB
LI
LightOnOCR 3 0.8B
Lightonocr · Prathat
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5 4B Heretic
Qwen · Biomanticus
Params4.21B
Context256K
Smallest2.7 GB
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3Vl 30b A3B Thinking
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Huihui ai.Qwen3 8B Abliterated
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
WA
Wan2.1 T2V 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
CO
Yi Coder 9B Chat
Coder · bartowski
Params8.83B
Context128K
Q4_K_M5.3 GB
HU
HuatuoGPT O1 7B
Huatuogpt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
SE
sexeh time testing
Sexeh · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GA
GameScaling 9B S1
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.8-27B
Qwen · rax4901
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
qwen3 forced aligner 0.6b
Qwen · cstr
Params918M
Context—
Smallest0.5 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
MA
madlad400 3b mt
Madlad · cstr
Params2.94B
Context—
Smallest0.0 GB
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
MI
colgrep-agent-2B
MiniCPM · lightonai
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB