F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
HE
Hermes Storm lorablated
Hermes · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
HO
Holo2 4B
Holo · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
MI
MiniCPM 2B dpo fp32
MiniCPM · mradermacher
Params2.72B
Context4K
Q4_K_M1.8 GB
GL
LongWriter Glm4 9b
GLM · mradermacher
Params9.4B
Context1024K
Q4_K_M6.3 GB
CH
chatterbox nano
Chatterbox · cstr
Params180M
Context—
Smallest0.3 GB
OR
Ornith 1.0 9B Abliterated Fable
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
HE
HelpingAI 3B hindi
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
AD
C3TR Adapter
Adapter · webbigdata
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
Exe Turbo S V3
Lfm · exe-ai-harness
Params8.47B
Context125K
Q4_K_M5.2 GB
CA
calme-2.3-legalkit-8b
Calme · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
FL
FLUX.1 schnell Quantized
Flux · aifoundry-org
Params11.9B
Context—
Smallest3.9 GB
PA
Param2 17B A2.4B Thinking
Param · arunmcops
Params17.4B
Context32K
Q4_K_M10.5 GB
JE
Jev-Style-2B-Decision-v4
Jev · chaoliangUNSW
Params1.88B
Context256K
Q4_K_M1.3 GB
LI
T Lite Instruct 0.1
Lite · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SM
Smart-Lemon-Cookie-7B
Smart · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 9B OBLITERATED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SH
YuE2-3B
Sheetsage · thepatch
Params677M
Context24K
Q4_K_M2.5 GB
QW
UIGEN-X-32B-0727
Qwen · johnbridges
Params32.8B
Context40K
Q4_K_M20.0 GB
TA
Tanuki 8B Dpo v1.0
Tanuki · team-hatakeyama-phase2
Params7.51B
Context8K
Q4_K_M4.6 GB
QW
Qwen3 VL 8B Instruct Uncensored
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama3.2 3B ShiningValiant2
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
code review decisions
Code · yannelli
Params2.7B
Context32K
Q4_K_M1.7 GB
SA
Sailor2 1B Chat
Sailor · bartowski
Params988M
Context32K
Q4_K_M0.7 GB
LL
CodeLlama 7b Instruct Solidity
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
JE
Jeffan 4B 2010
Jeffan · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 4B Heretic v2
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3 8B GPT 5 Codex Distill
Qwen · TeichAI
Params8.19B
Context40K
Q4_K_M5.0 GB
IG
Igea-1B-instruct
Igea · mradermacher
Params1.01B
Context16K
Q4_K_M0.6 GB