F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · wangkanai
Params8.19B
Context256K
Smallest5.0 GB
Vision
JA
JarvisArt 1208
Jarvisart · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
FI
Fimbulvetr-11B-v2
Fimbulvetr · backyardai
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LI
Lite Oute 1 300M Instruct
Lite · mradermacher
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
QW
Qwen2.5 1.5B Instruct heretic
Qwen · saidutta69
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
NA
Nanonets OCR2 3B
Nanonets · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.5 4B
Qwen · prithivMLmods
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
LL
Meta Llama 3.1 8B Instruct Heretic
Llama · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
Index Nailong 2B
Index · IndexTeam
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3 14B Gemini 3 Pro Preview High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · divpasta123
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
LL
TransLLaMA2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LU
Ko-Luxia-8B-it
Luxia · mradermacher
Params8.17B
Context8K
Q4_K_M5.0 GB
GGUF
ST
stable diffusion 3.5 large turbo
Stable · city96
Params8.15B
Context—
Smallest4.8 GB
GGUF
LL
FuseChat Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · bartowski
Params630M
Context32K
Q4_K_M0.5 GB
GGUF
CA
Captain Eris Violet V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CO
C4Ai Command R 08 2024
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
GE
EZO Common 9B gemma 2 it
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
QW
Mixture Summarizer Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
SA
Samantha v5 wizardlm2
Samantha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 8B Instruct C_Abliterated v3
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingVision
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
NE
news title generator
News · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
QW
Qwen3 1.7B heretic
Qwen · saidutta69
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
GL
glm ocr crispembed
GLM · cstr
Params1.11B
Context—
Smallest0.0 GB
GGUF
PA
Pantheon Rp 1.6.2 22b Small
Pantheon · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
Roleplay

Other quants

Keep browsing