F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
MI
MiniCPM5 2B Abliterated Uncensored
MiniCPM · mondk
Params2.52B
Context128K
Q4_K_M1.6 GB
KU
Kr3a
Kutches · Kutches
Params12.9B
Context—
Q4_K_M7.5 GB
WI
Wingless_Imp_8B
Wingless · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
MiniCPM OCR Jev
MiniCPM · openbmb
Params1.88B
Context256K
Q4_K_M1.3 GB
ST
stable-audio-3-medium SAME-L
Stable · thepatch
Params—
Context—
Q4_K_M0.6 GB
GE
Ablation 187 Gemma3.Webnovels.Test.Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
JI
jinen-v1-xsmall-hf
Jinen · togatogah
Params36M
Context1K
Smallest0.0 GB
LL
ggml llava v1.5 7b
LLaVA · mys
Params6.74B
Context4K
Smallest4.1 GB
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
CO
Confucius4 R2T2
Confucius · netease-youdao
Params1.72B
Context64K
Q4_K_M1.1 GB
TE
Ternary Bonsai 1.7B
Ternary · prism-ml
Params1.72B
Context32K
Smallest0.5 GB
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
QW
Qwen2.5 VL 7B Abliterated Caption It
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
dolphin 2.9.3 mistral nemo 12b
Mistral · dphn
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ON
OneJev 4B
Onejev · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
MY
Mythos v2 9b
Mythos · fableforge-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
HO
Holo 3.1 4B
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
DA
DanTagGen alpha
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GE
Gemma 4 E2B It Heretic Ara
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2 Audio 7B Instruct
Qwen · mradermacher
Params7.75B
Context8K
Q4_K_M4.8 GB
DA
DanTagGen delta
Dantaggen · KBlueLeaf
Params393M
Context2K
Smallest0.3 GB
MI
MiniCPM V Apps
MiniCPM · tc-mb
Params912M
Context256K
Q4_K_M0.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB