F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 4b Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
AU
AURA Eve Tactical Instruct 3.8B
Aura · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
SO
sophisticated-pelican
Sophisticated · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WA
Wan2 1 HuMo 17B
Wan · VeryAladeen
Params17.1B
Context—
Smallest6.2 GB
GGUF
CA
CatunaMayo3B
Catunamayo · mradermacher
Params3.97B
Context32K
Q4_K_M2.4 GB
GGUF
PA
parakeet ctc 1.1b ja
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
PR
prometheus 7b v2.0
Prometheus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Joah-Llama-3-KoEn-8B-Coder-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
CY
Cydonia 22B v1
Cydonia · TheDrummer
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
PI
PixieZehirNano
Pixiezehirnano · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 3.1 8B Instruct
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · AI-Engine
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RoleplayVision
QW
Qwen2.5 Sex
Qwen · ystemsrx
Params1.54B
Context—
Smallest3.1 GB
GGUF
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
AL
TQ2.5 14B Aletheia v1
Aletheia · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama-3-WhiteRabbitNeo-8B-v2.0
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 8B Chinese Chat
Llama · second-state
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
CH
Chocolatine 3B Instruct DPO v1.0
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · HiddenViper229
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
DI
digital socrates 7b
Digital · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.2 3B ORPO Advertisement
Llama · yothinS
Params3.2B
Context128K
Smallest1.4 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · mradermacher
Params539M
Context32K
Q4_K_M0.4 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
OpenBioLLM Llama3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GR
granite speech 4.1 2b nar
Granite · cstr
Params2.25B
Context—
Smallest1.6 GB
GGUF

Other quants

Keep browsing