F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
GGUF
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen2 0.5B NuminaMath TIR v1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
dnotitia_Smoothie Qwen3 0.6B
Qwen · Alcoft
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3 VL 2B Instruct heretic
Qwen · saidutta69
Params1.72B
Context256K
Q4_K_M1.1 GB
RoleplayTool useVision
UM
Umt5 Xxl
Umt · chatpig
Params5.68B
Context512
Q4_K_M3.7 GB
Coding
WA
wan s2v
Wan · calcuis
Params16.3B
Context—
Q4_K_M13.9 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3 0.9B A0.6B
Qwen · mradermacher
Params860M
Context40K
Q4_K_M0.6 GB
CodingReasoning
LL
Llama 3.1 Minitron 4B Width Base
Llama · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
ER
ERNIE Image
Ernie · unsloth
Params8.03B
Context—
Q4_K_M5.0 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ON
OneJev1.6 4B
Onejev · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
GE
Gemma-4-E2B-It
Gemma · mnsims1024
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3.5 9B Abliterated v2 MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
GGUF
IN
Index Homura 9B
Index · IndexTeam
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
LL
Meta llama_Meta Llama 3.1 8B Instruct
Llama · ThomasBaruzier
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM2 350M ENJP MT
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
GE
Forge 1 Gemma 4 E2B
Gemma · YoSaNoo
Params4.63B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MA
Maincoder 1B
Maincoder · mradermacher
Params1.03B
Context2K
Q4_K_M0.7 GB
Coding
QW
hermes qwen3.5 35b a3b
Qwen · DJLougen
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · bartowski
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
YU
Yue2-3B-GGUF
Yue · tungnguyen84
Params677M
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.5 4B MultiDistill 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision

Other quants

Keep browsing