F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen_Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
LL
CodeLlama 7b Python Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
VI
vibevoice
Vibevoice · gguf-org
Params2.7B
Context—
Q4_K_M3.5 GB
GGUF
TA
tada tts 1b
Tada · cstr
Params447M
Context—
Smallest0.0 GB
GGUF
GL
Huihui GLM 4.6V Flash Abliterated
GLM · seanbailey518
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
FL
FLUX.2 klein 9B
Flux · drends
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
OR
Orpheus 3b 0.1 Pretrained GGUF
Orpheus · HorizonNexusAI
Params3.3B
Context128K
Q4_K_M2.1 GB
GGUF
LL
WizardLM Mistral CodeLlama 7b
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
GGUF
NU
NuExtract v1.5
Nuextract · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Qwen3.5 0.8B Heretic
Qwen · saidutta69
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
OR
Ornstein 27B
Ornstein · GestaltLabs
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
MI
Mixtral AI CyberUltron DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · second-state
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
AN
AnLLM-EP-xllarge-wikiart
Anllm · mradermacher
Params368M
Context4K
Q4_K_M0.2 GB
GGUF
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GR
GroundGUI 8B
Groundgui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
MI
Mistral Scary Story Finetune
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
EM
Emma 6 Hf
Emma · PaoloneSborracchione
Params1.55B
Context4K
Q4_K_M1.0 GB
Coding
WI
WizardLM-2-8x22B
Wizardlm · backyardai
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · Andycurrent
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 9B
Qwen · prithivMLmods
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
BU
Buddy E4B v2
Buddy · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
FL
flux.1 schnell
Flux · Green-Sky
Params84M
Context—
Smallest0.1 GB
GGUF
AU
Aura 4B
Aura · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
RoleplayTool use
QW
dgpl linux assistant 0.8b
Qwen · dgpl
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing