F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Magos K8S 0.6b
Qwen · clglavan
Params596M
Context40K
Q4_K_M0.4 GB
ME
Meltemi 7B v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.5 2B Uncensored Abliterix SOM
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
AY
aya-23-8B
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GR
Granite 3.2 2b Instruct
Granite · ibm-research
Params2.53B
Context128K
Q4_K_M1.5 GB
MA
Anthracite Org_Magnum v2 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 8B 64k Context 2X Josiefied Uncensored
Qwen · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
FA
Fara1.5 9B
Fara · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
DR
DRT O1 7B
Drt · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Suri Qwen 3.5 9B Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 4B MultiDistill 3xMerge
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
HA
Hatheno Max 8B model stock
Hatheno · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
TR
Trendyol-LLM-7b-chat-v1.8
Trendyol · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 3B Uncensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen 2.5 7B Instruct novel lora
Qwen · cgxjdzz
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Andy 3.5 beta
Qwen · Sweaterdog
Params7.62B
Context128K
Smallest15.2 GB
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Ada Coder Qwen2.5 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ME
Medgemma 4b It
Medgemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
LF
LFM3 Omni 2B
Lfm · erenyeager-1
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
PE
PepperOCR VL
Pepperocr · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
PU
public poetry 50m
Public · wildfellhall
Params47M
Context1K
Smallest0.1 GB
MO
Moonshine Base (Arabic)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
VI
Vistral 7B MT
Vistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
MO
moonshine base zh
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
TO
Tower Plus 9B
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB