F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemini Nano Gemmafied
Gemma · mradermacher
Params3.24B
Context8K
Q4_K_M2.1 GB
GGUF
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
QW
Qwen3.8 27B thinkingcap abliterated mtp
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KA
KAI 7B Instruct v0.1
Kai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 ASR 1.7B
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
KI
Kiel 2 VQA
Kiel · kiel2
Params7.6B
Context125K
Q4_K_M4.7 GB
Vision
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 VL Abliterated Caption
Qwen · prithivMLmods
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
AA
aac board generator 770m ptbr
Aac · tardellirs
Params772M
Context32K
Q4_K_M0.6 GB
GGUF
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool useVision
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
qwen3 4b Z Image Engineer
Qwen · BennyDaBall
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
JA
japanese-novel-gpt-j-6b
Japanese · mmnga
Params6.05B
Context2K
Q4_K_M3.7 GB
GGUF
MA
magnum v2 4b
Magnum · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
DO
dots tts soar
Dots · cstr
Params2.2B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context32K
Q4_K_M0.4 GB
Coding
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
DE
Decision 4b Hf
Decision · evalengine
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
ST
Stheno Hercules 3.1 8B
Stheno · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision

Other quants

Keep browsing