F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
TU
Tulu 2 7b
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
SA
Sailor-1.8B-Chat
Sailor · mradermacher
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
JS
JSL MedMNX 7B v4.0
Jsl · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
MN BackyardAI Party 12B v1
Backyardai · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
Evolved Llama3 8B
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenELM 1_1B
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
GE
Jevify Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
SH
Shark-1-Ogno-9b-passthrough
Shark · mradermacher
Params9B
Context32K
Q4_K_M5.4 GB
GGUF
VI
T VisStar v0.1
Visstar · mradermacher
Params7.3B
Context32K
Q4_K_M4.4 GB
GGUF
HU
HuatuoGPT O1 8B
Huatuogpt · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
ST
stable-audio-3-small-music SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
GGUF
GL
Gliese OCR 7B Post2.0 Final
Gliese · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3 4B Thinking heretic
Qwen · saidutta69
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
kunoichi-lemon-royale-v2-32K-7B
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
K2 Horizon 7B Heretic
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 4B Thinking MiniMax M2.1 Coder
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
QW
Qwen2.5 VL 32B Instruct
Qwen · samgreen
Params689M
Context125K
Q4_K_M19.9 GB
Vision
YI
Yi 6B
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
FI
FireRedLID
Fireredlid · cstr
Params887M
Context—
Smallest0.4 GB
GGUF
QW
Qwen Image Edit 2511
Qwen · Daex032
Params20.4B
Context—
Q4_K_M13.2 GB
GGUF
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
JU
Jupiter G 8B
Jupiter · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
SP
Spark X2.6 1.7B
Spark · mradermacher
Params1.71B
Context1024K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · Dani-3
Params4B
Context256K
Smallest4.3 GB
Vision
LL
Llama 3 8B Web
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IR
irodori tts
Irodori · cstr
Params98M
Context—
Smallest0.0 GB
GGUF

Other quants

Keep browsing