F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3 VL Embedding 8B
Qwen · VesNFF
Params7.6B
Context256K
Smallest6.2 GB
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
QW
Qwen2.5 Vl 7b Cam Motion
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
IN
index echo 2b
Index · cstr
Params1.88B
Context—
Smallest0.7 GB
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
PA
Parakeet TDT-CTC 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
IN
index echo 9b
Index · cstr
Params8.95B
Context—
Smallest1.3 GB
QW
Qwen3 4b Heretic
Qwen · DreamFast
Params11.8B
Context40K
Q4_K_M2.5 GB
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
LL
Dolphin 3.0 Llama 3.2 1b
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLaMA2 13B Tiefighter
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
SM
SmolVLM2-256M-Video-Instruct
Smolvlm · ggml-org
Params163M
Context8K
Q4_K_M0.1 GB
QW
Qwen2.5 1.5b
Qwen · ElementMerc
Params1.54B
Context32K
Q4_K_M1.0 GB
FI
Finch 7b
Finch · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
QW
Qwen3.8 27B Uncensored
Qwen · MiawTeam
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 VL 8B NSFW Caption V4.5 Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
MiniCPM Llama3 V 2 5
Llama · openbmb
Params8.2B
Context8K
Q4_K_M4.9 GB
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
DE
Qwen3.5 9B Distill Deepseek V4.1 Flash 20261004
DeepSeek · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
MO
moondream2
Moondream · ggml-org
Params1.42B
Context2K
Smallest2.8 GB
QW
Qwen3 4B Instruct 2507 Polaris Alpha Distill Heretic Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
IM
Z-Image-Engineer-V6-SMART-DoRA-StyleBlendV9-25V17-75
Image · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB