F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
HolyYi-9B
Holyyi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
QW
Qwen2.5 3B sex GPRO float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · second-state
Params14B
Context128K
Q4_K_M8.6 GB
Coding
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.9B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma 4 E4B It
Gemma · prithivMLmods
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GA
Garryvik-0.1-7b
Garryvik · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Veloxy Flash 15B
Veloxy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
RU
rudra
Rudra · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Tool useVision
QW
Qwopus3 5 9B Coder Flash
Qwopus · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
LL
Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 4b It Uncensored v2
Gemma · Andycurrent
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Huihui-Qwen3.5-9B-abliterated
Qwen · Mungert
Params8.95B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
PA
Pantheon Rp Pure 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay
HE
Helcyon Aurora 12b v1.0
Helcyon · XeyonAI
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
WA
Watt Tool 8B GGUF
Watt · eaddario
Params8B
Context128K
Q4_K_M4.4 GB
Tool use
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · second-state
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
KA
KangalKhan Alpha Sapphiroid 7B Fixed
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ST
StoryFusion-7B
Storyfusion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NI
NightyGurps 14b v1.1
Nightygurps · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
DI
DialoGPT small crybaby
Dialogpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen3 VL 8B Instruct Unredacted MAX Quants
Qwen · KuroTo4ka
Params8.2B
Context256K
Q4_K_M5.0 GB
RoleplayVision
ME
MedASR
Medasr · handy-computer
Params105M
Context—
Q4_K_M0.1 GB
GGUF
SP
sphynx 7B ties
Sphynx · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
Coding
AN
Andy 4.2
Andy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Other quants

Keep browsing