F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 2B Uncensored Zero Refusal
Qwen · AkaumiKaede
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayTool use
BA
Barcenas-9b
Barcenas · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
HP
hpc coder v2 1.3b
Hpc · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
ZE
zeta2
Zeta · bluevoid-pl
Params8.25B
Context32K
Q4_K_M5.1 GB
GGUF
QW
Qwen3 Embedding 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
QW
prithivMLmods.Bootes Xuange Qwen 14B
Qwen · csabakecskemeti
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
BE
bella-2-8b
Bella · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 VL 8B Heretic 1.3.0
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3.5 9B
Qwen · Smoffyy
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
PI
piper en US lessac medium
Piper · cstr
Params16M
Context—
Smallest0.0 GB
GGUF
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
Reasoning
QW
QwQ LCoT 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
QW
Coder GRPO 3B
Qwen · yasserrmd
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
ZE
Zen Vl 8b Instruct
Zen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LL
lolzinventor Meta Llama 3.1 8B SurviveV3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
MI
Infinity Instruct 7M 0729 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 30B A3B
Qwen · ggml-org
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
DA
L3.1 Dark Reasoning LewdPlay Evo Hermes R1 Uncensored 8B
Dark · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplayTool use
LL
Humanish Roleplay Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
EL
Eleusis 12B
Eleusis · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DU
DualMind
Dualmind · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2.5 Coder 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
GL
Chatglm3 6b
GLM · mradermacher
Params6.24B
Context8K
Q4_K_M4.1 GB
GGUF
DA
danube2-1.8b-Synthia-v1.3
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
LL
LLaMA3 Reasoning
Llama · mradermacher
Params157M
Context128
Q4_K_M0.1 GB
Reasoning
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.4 GB
GGUF
QW
Replete Coder Qwen2 1.5b
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
LL
Llama 3.2 1B Instruct Uncensored
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay

Other quants

Keep browsing