F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 Audio 1.5B
Lfm · LiquidAI
Params190M
Context125K
Smallest0.1 GB
Vision
GE
Gemma 3 1b It
Gemma · ggml-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
SM
TwIL LM3
SmolLM · webAI-Official
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
QW
Qwen3-ASR 1.7B
Qwen · handy-computer
Params2.04B
Context—
Q4_K_M1.3 GB
GGUF
LI
Ling 3.0 Tiny
Ling · bloomer010
Params7.89B
Context128K
Q4_K_M4.8 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
s1 mini
Mini · superwhisper
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
XX
T5 V1_1 Xxl
Xxl · city96
Params4.76B
Context512
Q4_K_M2.9 GB
Coding
QW
Parable Qwen3 8B Claude Fable 5
Qwen · AnkitAI
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GE
gemma 4 12B it qat
Gemma · unsloth
Params440M
Context256K
Smallest0.3 GB
Vision
QW
Parable Qwen3 4B Claude Fable 5
Qwen · AnkitAI
Params4B
Context40K
Q4_K_M2.5 GB
Reasoning
MI
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Smallest1.2 GB
ReasoningTool use
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
BG
bge small en v1.5
BGE · unsloth
Params33M
Context512
Smallest0.1 GB
Embedding
FL
FLUX.1 dev
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
WA
Wan2.1 I2V 14B 480P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
YU
Yue2-3B-GGUF
Yue · audio-cpp
Params3.63B
Context—
Smallest0.3 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · LiquidAI
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
MI
MiniCPM5 1B Claude Opus Fable5 Thinking
MiniCPM · GnLOLot
Params1.08B
Context128K
Q4_K_M0.7 GB
Reasoning
AR
ark asr 3b
Ark · cstr
Params3.75B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3Vl 2b Instruct
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GE
gemma 4 26B A4B it qat
Gemma · unsloth
Params430M
Context128K
Smallest0.3 GB
Vision
GR
Parable Granite 4.1 3B Claude Fable 5
Granite · AnkitAI
Params3.4B
Context128K
Q4_K_M2.1 GB
ReasoningTool use
LL
Llama-3.2-3B-Instruct
Llama · unsloth
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GR
Parable Granite 4.1 8B Claude Fable 5
Granite · AnkitAI
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
QW
Qwen3-ASR 0.6B
Qwen · handy-computer
Params782M
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF

Other quants

Keep browsing