F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Stheno v3.4
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M1.9 GB
GGUF
LF
LFM2 24B A2B
Lfm · LiquidAI
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
QW
Qwen3 VL 8B Instruct Abliterated v2.0
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
QW
Qwen3.8 27B Omnimerge v6
Qwen · ManniX-ITA
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen Image Edit 2509
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
Embedding
NE
privacy-filter-nemotron
Nemotron · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
GGUF
GE
26B A4B
Gemma · terrorswift
Params25.2B
Context256K
Smallest0.5 GB
Vision
MU
Muse Glimmer 30B Abliterated
Muse · The-freezer
Params28B
Context128K
Q4_K_M1.6 GB
Vision
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · openbmb
Params214M
Context256K
Q4_K_M0.1 GB
Tool useVision
WA
Wan2.1 T2V 1.3B
Wan · samuelchristlie
Params1.42B
Context—
Q4_K_M1.0 GB
GGUF
GR
granite 4.0 1b speech
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · Voodisss
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Qwen2 VL 2B Instruct
Qwen · ggml-org
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
GP
Huihui Gpt Oss 20b BF16 Abliterated
gpt-oss · huihui-ai
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Huihui Qwen3 4B Abliterated v2
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
WH
Whisper Medium (English)
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Unredacted MAX
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · petruhonk
Params9.2B
Context256K
Smallest9.8 GB
GGUF
OM
d1-omni-600M
Omni · LiquidAI
Params381M
Context125K
Smallest0.4 GB
Vision
CA
Canary 1B
Canary · handy-computer
Params1.02B
Context—
Q4_K_M0.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.2 11B Vision Instruct
Llama · leafspark
Params9.78B
Context128K
Q4_K_M6.0 GB
Vision
MI
MiniCPM V 2 6
MiniCPM · openbmb
Params7.61B
Context32K
Q4_K_M4.7 GB
Vision
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use

Other quants

Keep browsing