F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
FU
Fun CosyVoice3 0.5B 2512
Fun · Lourdle
Params859M
Context—
Q4_K_M0.6 GB
GGUF
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
Vision
RA
RakutenAI 7B Chat
Rakutenai · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5-VL-7B-Instruct
Qwen · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
QW
qwen image edit
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
Vision
QW
Qwen3.8-27B
Qwen · aiartorious
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
GR
Granite 3.1 1b A400M Instruct
Granite · bartowski
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
SU
Sugoi 14B Ultra
Sugoi · sugoitoolkit
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.8 9b Hermes Function Calling v2
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Tool useVision
JI
jina embeddings v4 text retrieval
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
EmbeddingVision
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
WA
Wan2.1 T2V 14B FusionX VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
SE
SenseVoiceSmall
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
GGUF
GA
GameScaling 9B S3
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GE
gemma 4 E4B it heretic
Gemma · saidutta69
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
IM
Z Image Turbo sdcpp
Image · wbruna
Params84M
Context—
Smallest0.2 GB
GGUF
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
AR
Arctic Text2SQL R1 7B
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
HO
K2 Horizon 7B Uno Uncensored
Horizon · geantendormi
Params9B
Context512K
Smallest5.1 GB
GGUF
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
Vision
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
NE
nexus medical
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
CH
chatterbox
Chatterbox · cstr
Params264M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision

Other quants

Keep browsing