F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
GL
Glm 4 9b Chat 1m
GLM · bartowski
Params9.48B
Context1024K
Q4_K_M6.3 GB
BI
bibo asr ckpt
Bibo · fhai50032
Params120M
Context—
Smallest0.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3Vl 2b Thinking
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
CH
Chronos Gold 12B 1.0
Chronos · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwopus3.6 35B A3B v1 APEX MTP
Qwopus · mudler
Params35.5B
Context256K
Smallest11.7 GB
IN
Intern-S1-Mini
InternLM · internlm
Params8.2B
Context40K
Smallest8.7 GB
YI
Configurable-Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
DA
Dans PersonalityEngine v1.0.0 8b
Dans · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
WA
Phantom Wan 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
PH
FC PHI 3.5 Mini Merged 1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Dolphin-Mistral-24B-Venice-Edition
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.5 GB
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
Phi 3 Mini 4k Instruct
Phi · SanctumAI
Params3.82B
Context4K
Q4_K_M2.4 GB
HU
Huihui HY MT1.5 1.8B Abliterated
Huihui · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GR
granite speech 4.1 2b
Granite · cstr
Params2.31B
Context—
Smallest1.8 GB
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
QW
Qwen3 1.7B Distilled 30B A3B SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
GA
Garryvik-0.1-7b-Linear
Garryvik · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
UI TARS 2B SFT
Tars · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
LL
llama 2 7b chat sexed version5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OL
OLMo 2 0425 1B Instruct
OLMo · allenai
Params1.48B
Context4K
Q4_K_M0.9 GB
JI
jina embeddings v4 text code
Jina · jinaai
Params3.1B
Context125K
Q4_K_M1.9 GB
DI
dinov3-vitl16-pretrain-lvd1689m
Dinov · LocalAI-io
Params303M
Context—
Smallest0.6 GB
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB