F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingTool useVision
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
GGUF
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
alist food text qwen35
Qwen · NateRunsA-LIST
Params44M
Context256K
Q4_K_M1.3 GB
Vision
LL
Llama 3.2 1B Instruct
Llama · gaianet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · nightmedia
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
IN
Index Nailong 9B
Index · IndexTeam
Params8.95B
Context224K
Q4_K_M5.6 GB
GGUF
QW
Qwen3-4B-Nymphaea-RP
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Roleplay
NE
Nemotron 3.5 Embed 1B BF16
Nemotron · W4D
Params1.14B
Context256K
Q4_K_M0.7 GB
EmbeddingVision
QW
Qwen3 VL 4B Instruct Abliterated v1
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3 0.6B TLDR Lora
Qwen · phh
Params1M
Context—
Smallest0.0 GB
GGUF
NS
NSFW_13B_sft
Nsfw · mzwing
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
LF
LFM2 VL 3B
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
Vision
QW
Replete LLM V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
OM
omnivoice-tokenizer
Omnivoice · cstr
Params613M
Context—
Smallest0.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
KO
kokoro 82m
Kokoro · cstr
Params82M
Context—
Smallest0.1 GB
GGUF
VL
VLX Seek 1.5 10B
Vlx · Asher-1
Params1.1B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
QW
qwen3loop 0.6b sft deep supervision v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
ReasoningVision
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
Zeta 2.1
Zeta · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
GGUF
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
FA
Falcon H1 7B Instruct
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
IM
Z Image Turbo
Image · tsqn
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
QW
GPT neo Custom 7B
Qwen · Szymon-Wachelko
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
YI
EVA Yi 1.5 9B 32K V1
Yi · bartowski
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF

Other quants

Keep browsing