F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
TH
TherapyLlama 8B v1
Therapyllama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SH
Sharp Coder V0.1
Sharp · Weinel-Ventures
Params161M
Context1K
Smallest0.3 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Loverboy69
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GR
Granite 3.2 8b Instruct
Granite · ibm-research
Params8.17B
Context128K
Q4_K_M4.9 GB
ST
stable cypher instruct 3b
Stable · ragraph-ai
Params2.8B
Context16K
Q4_K_M1.7 GB
HA
Hammer2.1 7b GGUF
Hammer · eaddario
Params7.61B
Context32K
Q4_K_M4.2 GB
SM
smollm1.7b slerp
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
YI
Yi-9b-v1.1
Yi · mradermacher
Params8.95B
Context4K
Q4_K_M5.4 GB
LL
Llama Guard 3 8B
Llama · eaddario
Params8.03B
Context128K
Q4_K_M4.4 GB
QW
Qwen3.5 9B Ultra Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
FE
Kunocchini 7b 128k test GGUF Imatrix
Fett · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM5 2B
MiniCPM · eaddario
Params2.52B
Context—
Smallest0.0 GB
GE
Gemma 4 E2B It GMCE
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen2 Audio 7B Instruct
Qwen · second-state
Params7.75B
Context8K
Q4_K_M4.8 GB
GP
GPT4chan 8B
Gpt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
a fixed output model
Fixed · lijie1228
Params—
Context8K
Q4_K_M0.0 GB
WA
Wayfarer 12b
Wayfarer · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
VS
VST 3B
Vst · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MO
MotherEarth Hermes Storm Climate Sauerkraut abliterated
Motherearth · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
SatellaRAG 0.8B
Qwen · EphAsad
Params773M
Context256K
Q4_K_M0.5 GB
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
BI
BiRefNet_lite
Birefnet · Acly
Params220M
Context—
Smallest0.1 GB
IR
Irodori-TTS-v4-Large
Irodori · sakasegawa
Params3.38B
Context—
Smallest2.6 GB
LL
Llama 4 Scout 17B 16E Instruct 4bit
Llama · glogwa68
Params17B
Context9766K
Q4_K_M22.5 GB
LL
liuhaotian llava v1.5 13b
LLaVA · PsiPi
Params13B
Context4K
Smallest5.4 GB
LL
Layerskip Llama3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Shrey Ai 2 27B
Qwen · MRSHREY197
Params26.9B
Context256K
Smallest5.9 GB