F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.6 27B
Qwen · froggeric
Params461M
Context256K
Q4_K_M16.8 GB
MI
Huihui MiniCPM V 4 5 abliterated
MiniCPM · huihui-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
LLaVA-NeXT-Video-7B-DPO
LLaVA · ManishThota
Params6.74B
Context4K
Smallest7.2 GB
PH
Phi 3 Mini 4k Instruct
Phi · second-state
Params3.82B
Context4K
Q4_K_M2.4 GB
SM
SmolLM2 360M Instruct
SmolLM · unsloth
Params362M
Context8K
Q4_K_M0.3 GB
AS
AstaBrief_8B
Astabrief · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 4B
Qwen · Smoffyy
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma 3 4B it Uncensored
Gemma · lemuralabs
Params3.88B
Context128K
Smallest1.2 GB
ME
MechVL 4B RL
Mechvl · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
LF
LFM2.5 8B A1B heretic
Lfm · saidutta69
Params8.47B
Context125K
Q4_K_M5.2 GB
SM
SmolVLM Instruct
Smolvlm · ggml-org
Params1.81B
Context16K
Q4_K_M1.1 GB
LF
LFM2 1.2B Tool
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
OX
OxCoder 9B
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HO
Holo 3.1 9B
Holo · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
MO
moss tts v1.5
Moss · cstr
Params1.77B
Context—
Smallest3.5 GB
QW
CaptchaKraken v1.2
Qwen · CaptchaKraken
Params8.95B
Context256K
Q4_K_M5.6 GB
HY
HY MT1.5 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
ME
mel band roformer vocals
Mel · cstr
Params228M
Context—
Smallest0.5 GB
MO
Moonshine Streaming Tiny
Moonshine · handy-computer
Params44M
Context—
Smallest0.1 GB
QW
Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 4B Instruct
Qwen · openresearchtools
Params4.21B
Context256K
Q4_K_M2.7 GB
QV
QVikhr 3 4B Instruction
Qvikhr · Vikhrmodels
Params4B
Context40K
Q4_K_M2.5 GB
GE
Gemma SEA LION v4 4B VL
Gemma · aisingapore
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
LF
LFM2.5 1.2B Instruct DSpark Draft v1
Lfm · LiquidAI
Params296M
Context125K
Q4_K_M0.2 GB
DE
DeepSeek R1 Distill Qwen 8B Abliterated
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LA
laya_multilingual_unsloth_dynamic
Laya · mys
Params323M
Context—
Q4_K_M0.5 GB