F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Copium Cola 9B GGUF IQ Imatrix
Copium · Lewdiculous
Params9B
Context32K
Q4_K_M5.4 GB
Roleplay
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
gemma 4 12B it heretic
Gemma · saidutta69
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
SE
Seed Coder 8B Instruct
Seed · second-state
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
OP
openthaigpt 1.0.0 7b chat
Openthaigpt · openthaigpt
Params6.81B
Context4K
Q4_K_M4.1 GB
GGUF
VI
VibeThinker 1.5B
Vibethinker · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
GE
Gemma 2 2b TitanFusion
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Nidum Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Huihui ai.Qwen3 30B A3B Abliterated
Qwen · DevQuasar
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
GGUF
ER
baidu.ERNIE 4.5 300B A47B PT
Ernie · DevQuasar
Params300B
Context128K
Q4_K_M180.2 GB
GGUF
NI
NIHAPPY L3.1 8B v0.09
Nihappy · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 1.7B
Qwen · lm-kit
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
SP
SP3F 7B
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
TI
TinySwallow 1.5B Instruct
Tinyswallow · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
SA
Sailor-0.5B-Chat
Sailor · sail
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
MI
Mixtral-seed-pollux-v0.1
Mistral · mradermacher
Params520M
Context128K
Q4_K_M0.3 GB
GGUF
CY
cybertron v4 qw7B UNAMGS
Cybertron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QI
Qianfan-OCR
Qianfan · Mungert
Params4.42B
Context32K
Q4_K_M3.1 GB
ReasoningVision
MI
Ministral 3 14B Nymphaea RP heretic
Mistral · Yingyaeliae
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool use
OP
OpenELM 450M
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
BL
BlackMagic-7B
Blackmagic · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Mr MARTIN 9B 3.5 vision OMNI
Qwen · ZERO-POINT-AI
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
EU
EuroLLM 9B Instruct heretic
Eurollm · saidutta69
Params9.15B
Context4K
Q4_K_M5.6 GB
Roleplay
LI
lift
Lift · prithivMLmods
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
YI
Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF

Other quants

Keep browsing