F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
GE
Gemma 2 9b It WPO HB
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum v3 9b customgemma2
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Selora AI LLM 1.7B
Qwen · selorahomes
Params2.03B
Context40K
Smallest0.0 GB
QW
Qwen3.5 4B NSFW Literotica
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Artificium llama3.1 8B 001
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ZE
Zephyr 7B Beta Harmless
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hare 1.1B Base 0.75v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
KAI 7B v0.1
Kai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
luvGPT phi3 uncensored chat
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
AT
Athena-OrpoMistral-7B-Chat-v0.1
Athena · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
HelpingAI Lite
Helpingai · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
EM
emma 5
Emma · MrMeOrYou
Params614M
Context2K
Q4_K_M0.4 GB
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
MI
Mistral Nemo Instruct 2407
Mistral · second-state
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Qwen 7B abliterated
DeepSeek · ngxson
Params7.6B
Context128K
Q4_K_M4.7 GB
MI
OpenChat 3.5 7B Mixtral v2.0
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen2.5 VL 7B NSFW Caption V4
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
YO
Youri 7b Instruction
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · Andycurrent
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen_Qwen3 4B
Qwen · Alcoft
Params4.02B
Context40K
Q4_K_M2.5 GB
KA
KangalKhan RawEmerald 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Granite 3.0 1b A400M Instruct
Granite · bartowski
Params1.33B
Context4K
Q4_K_M0.8 GB
QW
X Coder RL Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3Guard Gen 4B
Qwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
AH
Ahma 3B Instruct
Ahma · mradermacher
Params3.63B
Context2K
Q4_K_M2.8 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context128K
Q4_K_M0.4 GB
VE
VeriSeek
Veriseek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3.1 Tulu 3 8B DPO
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
KU
kugelaudio 0 open
Kugelaudio · cstr
Params8.64B
Context—
Smallest5.7 GB