F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · prithivMLmods
Params4B
Context256K
Smallest4.3 GB
Vision
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
QW
Qwen/Qwen3-Next-80B-A3B-Instruct
Qwen · lefromage
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
OL
Olmo-3-1025-7B
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
AL
AliceAI Foundation 80B A3B NOESIS BF16
Aliceai · AMAImedia
Params79.6B
Context256K
Q4_K_M48.3 GB
Coding
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
DE
Deepseek R1 Distill NSFW RPv1
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
EX
EXAONE 3.5 7.8B Instruct
Exaone · ThomasBaruzier
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
MI
ELISARCyberAIEdge7B LoRA
Mistral · sallani
Params42M
Context—
Smallest0.2 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
GGUF
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
SK
Sky T1 32B Preview
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
FI
Fin R1
Fin · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
Reasoning
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
Gemma 4 12B It
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
GL
GLM-ASR-Nano-2512
GLM · Mungert
Params1.59B
Context8K
Q4_K_M1.1 GB
GGUF
GE
Gemma 4 E4B It Erotica
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
LF
LFM2 1.2B Extract
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.5 9B Uncensored
Qwen · ccharnkij
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
WE
WeVisOne VL 4B
Wevisone · mradermacher
Params4.42B
Context256K
Q4_K_M2.7 GB
Tool useVision
HE
Hermes 4 14B
Hermes · gabriellarson
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
DA
danube3-4B
Danube · h2oai
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF

Other quants

Keep browsing