F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
FU
Fun CosyVoice3 0.5B 2512
Fun · Lourdle
Params859M
Context—
Q4_K_M0.6 GB
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
RA
RakutenAI 7B Chat
Rakutenai · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5-VL-7B-Instruct
Qwen · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
QW
qwen image edit
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
GR
Granite 3.1 1b A400M Instruct
Granite · bartowski
Params1.33B
Context128K
Q4_K_M0.8 GB
SU
Sugoi 14B Ultra
Sugoi · sugoitoolkit
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.8 9b Hermes Function Calling v2
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
JI
jina embeddings v4 text retrieval
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
WA
Wan2.1 T2V 14B FusionX VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
SE
SenseVoiceSmall
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
GA
GameScaling 9B S3
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
gemma 4 E4B it heretic
Gemma · saidutta69
Params7.46B
Context128K
Q4_K_M5.3 GB
IM
Z Image Turbo sdcpp
Image · wbruna
Params84M
Context—
Smallest0.2 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
AR
Arctic Text2SQL R1 7B
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
HO
K2 Horizon 7B Uno Uncensored
Horizon · geantendormi
Params9B
Context512K
Smallest5.1 GB
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
NE
nexus medical
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
CH
chatterbox
Chatterbox · cstr
Params264M
Context—
Smallest0.0 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB