F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenELM 1_1B Fix Nan
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
LL
FineMath Llama 3B
Llama · bartowski
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
KA
Katarau 9B Ru RP Nsfw
Katarau · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
ZE
zed industries zeta
Zeta · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CA
Captain Eris Violet GRPO v0.420 GGUF IQ Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
KA
kappa 3 phi abliterated
Kappa · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
ST
Starling LM 7B beta ExPO
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LF
lfm2.5 2.6b fable5 coding agent heretic
Lfm · AzariazIZI
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
PH
phi4
Phi · calcuis
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MA
Mamba 790m Hf
Mamba · mradermacher
Params790M
Context1024K
Q4_K_M0.5 GB
GGUF
SP
Spark X2.5 4B
Spark · eaddario
Params4.11B
Context—
Smallest0.0 GB
GGUF
CO
confucius4 r2t2
Confucius · cstr
Params2.35B
Context—
Smallest1.5 GB
GGUF
IN
InternVL3_5 4B
Internvl · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
CodingVision
RA
Raicho-7B-v0.1
Raicho · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CodingRoleplay
GR
Gromenauer-7B-Instruct
Gromenauer · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
QW
CodeQwen1.5-7B-Chat
Qwen · second-state
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
WI
WizardMath 7B V1.0
Wizardmath · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
XiYanSQL QwenCoder 3B 2504
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
LL
Mantella Skyrim Llama 3 8B
Llama · art-from-the-machine
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · LWDCLS
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
Qwen3.5 9B DeepSeek V4 Flash
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Featherless ai.Qwerky QwQ 32B
Qwen · DevQuasar-12
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
GE
guarani jopara gemma 2 2b it v1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Darkidol Gemma 4 E4B It
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
KA
KangalKhan Ruby 7B Fixed
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MA
Mano CUA 2.0 4B
Mano · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool useVision
MY
Mythos v2 8b Merged
Mythos · King3Djbl
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningRoleplayTool use
NA
Nanbeige4.3 33B
Nanbeige · CVLTAI
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use

Other quants

Keep browsing