F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
flux1 dev turbo
Flux · ChrisColeTech
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 8B NSFW Caption V4
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
KH
KhanomTanLLM Instruct
Khanomtanllm · mradermacher
Params3.45B
Context2K
Q4_K_M2.6 GB
GGUF
QW
CapRL Qwen3VL 4B
Qwen · internlm
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool useVision
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
YI
Yi-1.5-9B-coder
Yi · mradermacher
Params8.83B
Context8K
Q4_K_M5.3 GB
Coding
MU
Muse-Glimmer-30B-Abliterated
Muse · cvgro
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision
LL
LLAMA 3_8B_Unaligned_BETA
Llama · bartowski
Params8B
Context16K
Q4_K_M4.9 GB
GGUF
KA
KangalKhan Alpha RawRubyroid 7B Fixed
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
palmyra mini thinking AIO
Palmyra · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.0 GB
CodingReasoning
MA
Marcoro14 7B slerp v2
Marcoro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Text to Sql llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Selene 1 Mini Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
BugTraceAI Apex G4 26B Master f16
Gemma · BugTraceAI
Params25.2B
Context256K
Smallest50.5 GB
ReasoningTool use
MI
Ministral 3 3B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
ZySec 7B
Securityllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NE
NVIDIA NemotronLabs VoiceChat 11B
Nemotron · hoidhxd
Params11.1B
Context—
Smallest0.3 GB
GGUF
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
PH
Phi 3 mini 4k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
Llama SEA LION v3 70B IT
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AN
ANMOLGPT 4B v0.2
Anmolgpt · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
Miss MARTHA 9B Qwen3.5 Omni
Qwen · ZERO-POINT-AI
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
SA
Sailor-0.5B
Sailor · mradermacher
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 VL 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context125K
Q4_K_M1.9 GB
RoleplayVision
DI
DiagnosisGPT 6B
Diagnosisgpt · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
Embedding

Other quants

Keep browsing