F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.8 27B Uncensored Q4 K M
Qwen · qaqab
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
rombos Llama3 8B Instruct Replete Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated GGUF ARMADO
DeepSeek · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
PY
Pythia 410m Deduped
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
BL
BlackSheep RP 12B
Blacksheep · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
maya1
Maya · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GR
Granite Speech 5.0 470M TurboCTC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
OX
oxy 1 small
Oxy · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
OU
Oumuamua-7b-instruct-v2-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepHat V1 7B Heretic Abliterated
Deephat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ZO
zonos v0.1 transformer
Zonos · cstr
Params1.62B
Context—
Smallest0.0 GB
ON
OneJev1.6 0.8B
Onejev · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
IN
AlchemistCoder-L-7B
InternLM · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
EN
ensql 1 4
Ensql · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AS
astrollama 3 8b base summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ST
sd3.5 large
Stable · gguf-org
Params695M
Context—
Smallest0.2 GB
AM
AmberChat
Amberchat · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LF
LFM2.5 Encoder 350M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
WE
WeVisOne VL
Wevisone · PALLER-NOVUS
Params407M
Context256K
Q4_K_M1.3 GB
PH
Phi 3 song lyrics 1.0
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
KA
KangalKhan Alpha Rubyroid 7B Fixed
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Biggie SmoLlm 0.4B
SmolLM · mradermacher
Params448M
Context2K
Q4_K_M0.3 GB
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Mahou-1.3-M1-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
XX
T5 V1_1 Xxl
Xxl · chatpig
Params4.76B
Context512
Q4_K_M2.9 GB
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
ST
StartLux Decision v1 9B
Startlux · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB