F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
YO
Youri 7b
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
LF
LFM2.5 1.2B Base
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
Mistral Large Instruct 2407
Mistral · second-state
Params123B
Context128K
Q4_K_M73.2 GB
FA
Falcon H1 0.5B Instruct
Falcon · tiiuae
Params521M
Context16K
Q4_K_M0.3 GB
BO
boto 7B v1.1
Boto · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SU
TQ2.5 14B Sugarquill v1
Sugarquill · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
LF
LFM2.5 2.6B heretic uncensored
Lfm · noctrex
Params2.7B
Context125K
Q4_K_M1.7 GB
DR
Dryad 7B ties
Dryad · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM5 1B Heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.8 2B Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
PA
parakeet rnnt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
QW
Qwen3.5 4B Uncensored Aggressive
Qwen · tinyopsec
Params4.33B
Context256K
Q4_K_M2.8 GB
BA
BananaMind Translate V3.5 Pro
Bananamind · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
BI
BioTakuya
Biotakuya · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
LFM2 350M Math
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen2.5 Coder 7B Instruct OBLITERATED
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
OS
OSim 8B
Osim · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3.5 9B CyberOps
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
AV
Avrik Lite 4B
Avrik · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
KA
KangalKhan NeoRuby 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB