F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM5 2B Abliterated Uncensored
MiniCPM · mondk
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
KU
Kr3a
Kutches · Kutches
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
WI
Wingless_Imp_8B
Wingless · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
MiniCPM OCR Jev
MiniCPM · openbmb
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
ST
stable-audio-3-medium SAME-L
Stable · thepatch
Params—
Context—
Q4_K_M0.6 GB
GGUF
GE
Ablation 187 Gemma3.Webnovels.Test.Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
JI
jinen-v1-xsmall-hf
Jinen · togatogah
Params36M
Context1K
Smallest0.0 GB
GGUF
LL
ggml llava v1.5 7b
LLaVA · mys
Params6.74B
Context4K
Smallest4.1 GB
Vision
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
CO
Confucius4 R2T2
Confucius · netease-youdao
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
TE
Ternary Bonsai 1.7B
Ternary · prism-ml
Params1.72B
Context32K
Smallest0.5 GB
GGUF
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
GGUF
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
GGUF
QW
Qwen2.5 VL 7B Abliterated Caption It
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
dolphin 2.9.3 mistral nemo 12b
Mistral · dphn
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingTool use
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
EmbeddingVision
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
ON
OneJev 4B
Onejev · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
Vision
MY
Mythos v2 9b
Mythos · fableforge-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Tool use
HO
Holo 3.1 4B
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
GGUF
DA
DanTagGen alpha
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GGUF
GE
Gemma 4 E2B It Heretic Ara
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen2 Audio 7B Instruct
Qwen · mradermacher
Params7.75B
Context8K
Q4_K_M4.8 GB
Vision
DA
DanTagGen delta
Dantaggen · KBlueLeaf
Params393M
Context2K
Smallest0.3 GB
GGUF
MI
MiniCPM V Apps
MiniCPM · tc-mb
Params912M
Context256K
Q4_K_M0.5 GB
Vision
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF

Other quants

Keep browsing