F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5 Text 9B NSFW RP RolePlay
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
NemoMix Unleashed 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
MU
Muse Glimmer 30B Heretic Uncensored
Muse · 0bserverx
Params28B
Context128K
Q4_K_M16.9 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
IN
Index Translate 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · openbmb
Params389M
Context256K
Q4_K_M0.2 GB
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3.5 9b Nsfw Captioning v5
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SM
SmolLM2 360M Instruct
SmolLM · bartowski
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
SM
SmolVLM 256M Instruct
Smolvlm · ggml-org
Params163M
Context8K
Smallest0.2 GB
QW
Qwen3 VL 8B GLM 4.7 Flash Heretic Uncensored Thinking
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
FU
Fun-ASR Nano
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
CL
Clef Flash Heretic
Clef · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
dolphin 2.9 llama3 8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
TU
SD Turbo
Turbo · Green-Sky
Params1.3B
Context—
Smallest2.0 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB