F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Huihui Qwen3.5 0.8B abliterated claude mythos distilled 25k
Qwen · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL 8B Instruct Uncensored V2
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
SM
SmolLM2 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
TE
Ternary Bonsai 4B
Ternary · prism-ml
Params4B
Context32K
Smallest1.1 GB
QW
MiMo V2.6 Distill Qwen 9B heretic
Qwen · saidutta69
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
llama3.1 airoboros3.2 QDT 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
WA
Wan22 FastMix
Wan · Zuntan
Params14.3B
Context—
Q4_K_M9.7 GB
KI
Kimi VL A3B Thinking 2506
Kimi · ggml-org
Params16B
Context128K
Q4_K_M10.5 GB
MI
MegaBeam Mistral 7B 512k
Mistral · bartowski
Params7.24B
Context512K
Q4_K_M4.4 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral Small Instruct 2409
Mistral · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
WH
whisper tiny
Whisper · FL33TW00D-HF
Params38M
Context—
Smallest0.0 GB
MA
MangaLMM
Mangalmm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
QW
Qwen3 Vl 8b Heretic 1.3.0
Qwen · DreamFast
Params8.19B
Context256K
Q4_K_M5.0 GB
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
CO
Confucius4 T3PO
Confucius · netease-youdao
Params14.8B
Context32K
Smallest10.5 GB
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen Image Edit
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
LL
dolphin-llama3-zh-cn-uncensored
Llama · stephenlzc
Params8B
Context8K
Q4_K_M4.9 GB
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
GD
GDP 4B
Gdp · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB