F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwentile2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
LF
LFM2.5 1.2B Thinking Claude 4.6 Opus Heretic Uncensored DISTILL
Lfm · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Reasoning
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GR
KV Ground 8B BaseGuiOwl1.5 0315
Ground · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Vision
AD
Adamus-7B-slerp
Adamus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 4B ORPO Advertisement
Qwen · yothinS
Params4B
Context40K
Smallest1.7 GB
GGUF
HU
hubert large ls960 ft
Hubert · cstr
Params315M
Context—
Smallest0.2 GB
GGUF
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
WA
WavTokenizer Large Speech 75token
Wavtokenizer · ggml-org
Params65M
Context8K
Smallest0.1 GB
GGUF
TI
Tiny LLM
Tiny · mradermacher
Params13M
Context1K
Q4_K_M0.0 GB
GGUF
CO
Cosmos Reason2 8B
Cosmos · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
Vision
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
CodeV-DS-6.7B
Codev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HE
HelpingAI flash
Helpingai · mradermacher
Params2.24B
Context4K
Q4_K_M1.4 GB
GGUF
DE
DeepSeek R1 Codegeneration COT
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingReasoning
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
IM
Impish_Mind_8B
Impish · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
CyberNeurova Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
NE
nemotron 3.5 asr streaming
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
GGUF
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
TA
UI TARS 7B SFT
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ON
OneJev1.6 9B
Onejev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Tifa 7B Qwen2 v0.1
Qwen · Tifa-RP
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
OU
Oumuamua-7b-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
PH
Phi 4 Mini Instruct Abliterated
Phi · Melvin56
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding

Other quants

Keep browsing