F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
ZE
LORAs
Zephyr · kukidevalml
Params4B
Context40K
Smallest8.1 GB
PH
llava phi 3 mini
Phi · xtuner
Params3.82B
Context4K
Smallest2.3 GB
KA
Kanana 1.5 8b Instruct 2505
Kanana · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
VI
Viking Magnum v0.1 7B
Viking · mradermacher
Params7.55B
Context4K
Q4_K_M4.6 GB
LL
Llama 3.2 3B Instruct
Llama · second-state
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Decider 4b
Decider · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
QwenStoryteller
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PO
Pony Realism
Pony · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
LL
Doktor-Llama-8b
Llama · mradermacher
Params6.84B
Context4K
Q4_K_M4.2 GB
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 8B Jailbroken
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
YI
Yi-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
DO
Doujinshi 14b Roleplay
Doujinshi · puwaer
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama 3 SnowyRP 8B V1 B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
DE
Deepthink Reasoning 7B
Deepthink · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DR
Drex v1.5
Drex · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 E4B It SDFT_Heretic_RP
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · eaddario
Params7.62B
Context128K
Q4_K_M4.2 GB
QW
Qwen3.5 9B RolePlay Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
DPO Trained Qwen2.5 Python Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
FL
Flux 3 Image Klein Prompt Upsampler Abliterated
Flux · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
FACET Terminal Qwen3.5 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CS
CSM 1B
Csm · BricksDisplay
Params457M
Context—
Q4_K_M0.8 GB
GR
Granite Guardian 3.3 8b
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
QW
MegaScience Qwen
Qwen · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron 3.5 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · NousResearch
Params8.03B
Context128K
Smallest4.7 GB
GE
Gemma 4 E2B It Heretic v1
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
BR
Breeze TTS 2
Breeze · Raxdiam
Params—
Context—
Smallest4.3 GB