F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
AR
ArmoniosaAnthea
Armoniosaanthea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DA
datagemma rag 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
LL
Athena-llama-Coder-3-8B
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
Coding
QW
Qwen3.5 2B_Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3.5 4B Jev Judge
Qwen · mradermacher
Params4.24B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
QW
dolphin-2.9.3-qwen2-0.5b
Qwen · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
Tool use
OP
OpenCoder 8B Instruct
Opencoder · bartowski
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
LL
Llama 3.1 8B Instruct
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek V4 Pro Qwen3.5 9B
DeepSeek · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
TI
tinyllama history
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 1.5B Spanish 1.0 DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
SM
SmallThinker 4BA0.6B Instruct
Smallthinker · Tiiny
Params4.27B
Context32K
Smallest1.9 GB
GGUF
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
LL
llama4 dolphin 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen3.8 4B Distill
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
SH
SharkOgno-7b-Task
Sharkogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
Zai org.GLM 5.3 Flash
GLM · DevQuasar
Params313B
Context1024K
Q4_K_M189.0 GB
Vision
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
KA
Kakaocorp.Kanana 1.5 8b Instruct 2505
Kanana · DevQuasar
Params8.03B
Context32K
Q4_K_M4.9 GB
Tool use
EU
EuroLLM 1.7B Instruct heretic
Eurollm · saidutta69
Params1.66B
Context4K
Smallest3.3 GB
GGUF
LL
Llama 3.2 3B Instruct heretic ablitered uncensored
Llama · tinyopsec
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
ME
melotts en v3
Melotts · cstr
Params95M
Context—
Smallest0.1 GB
GGUF
FL
FLOR 6.3B Instructed
Flor · xaviviro
Params6.45B
Context4K
Q4_K_M4.1 GB
GGUF
HA
Harmonic Hermes 9B
Harmonic · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF

Other quants

Keep browsing