F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
PH
Athene Phi 3.5 mini instruct orpo
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.3 GB
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.9B
Context128K
Q4_K_M4.8 GB
CH
chatterbox turbo
Chatterbox · cstr
Params266M
Context—
Smallest0.3 GB
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
QW
Qwen3.5 9B
Qwen · Smoffyy
Params8.95B
Context256K
Q4_K_M5.6 GB
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CR
CREPE (tiny)
Crepe · cstr
Params22M
Context—
Smallest0.0 GB
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Q4_K_M5.3 GB
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Smallest6.4 GB
SM
Biggie SmoLlm 0.15B Base
SmolLM · mradermacher
Params181M
Context2K
Q4_K_M0.1 GB
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
MI
OpenHermes 2.5 Mistral 7B Orca DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Q4_K_M2.0 GB
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
QW
MARTHA LXVII.8B QWEN 3.5 3.6 prune 9b 3.6 base
Qwen · ZERO-POINT-AI
Params8.1B
Context256K
Q4_K_M5.1 GB
GM
GmshNet 8B v0.1
Gmshnet · hexera-org
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Replete Coder V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
voxtral mini 3b 2507
Mistral · cstr
Params4.68B
Context—
Smallest2.7 GB
QW
Qwen2.5 Coder 14B n8n Workflow Generator
Qwen · evansanih
Params14.8B
Context32K
Q4_K_M9.0 GB
AM
Amaretto 8B
Amaretto · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
CO
cohere transcribe arabic 07 2026
Cohere · cstr
Params2.07B
Context—
Smallest0.0 GB
DI
DialFactSum ACU 8B
Dialfactsum · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB