F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
GGUF
BR
breeze-tts-2
Breeze · cstr
Params2.85B
Context—
Smallest2.2 GB
GGUF
FL
flux2 klein 9b uncensored text encoder
Flux · ponpoke
Params8.19B
Context—
Q4_K_M5.0 GB
Coding
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
HU
Hunyuan MT 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
LF
LFM3 1.7B
Lfm · LiquidAI
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
MI
MiniCPM V 4_6
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
Vision
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
ReasoningVision
QW
Therapy 3.8
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen3 VL 8B Instruct Abliterated v2
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB
GGUF
LF
LFM2 VL 1.6B
Lfm · LiquidAI
Params1.17B
Context125K
Smallest0.7 GB
Vision
JI
jina reranker v1 tiny en
Jina · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
MA
magnum v4 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LA
LatentSync 1.6
Latentsync · audio-cpp
Params1.37B
Context—
Smallest2.1 GB
GGUF
QW
Qwen3 14B Claude 4.5 Opus High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
PI
PII Tracer
Pii · perplexity-ai
Params596M
Context32K
Smallest1.2 GB
GGUF
CH
Chandra Ocr 2
Chandra · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
MI
MiniCPM OCR 1.0
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
CodingReasoning
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
Embedding
IN
Index Translate 35B A3B preview
Index · IndexTeam
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
LF
LFM2 2.6B
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen2.5 7b Ins v3
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing