F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
CE
Celestial Harmony 14b v1.0 Experimental 1016
Celestial · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Gemma 4 E4B It Apostate
Gemma · mradermacher
Params8.13B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
MI
mistral 7b uncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 TTS 12Hz 1.7B CustomVoice
Qwen · BricksDisplay
Params694M
Context32K
Q4_K_M1.1 GB
GGUF
MI
Lite-Mistral-150M-v2-Instruct
Mistral · mradermacher
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
GE
Gemma 4 E4B Abliterated
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
GO
Google CLD3
Google · cstr
Params—
Context—
Smallest0.0 GB
GGUF
PO
Polaris VGA 9B Post1.0e
Polaris · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
GGUF
AI
Aitana 7B S Instruct
Aitana · mradermacher
Params7.77B
Context8K
Q4_K_M4.9 GB
GGUF
QW
qwen3.5 4b gabliterated
Qwen · jwest33
Params4.21B
Context256K
Smallest4.5 GB
ReasoningTool useVision
QW
Qwen3 32B Abliterated
Qwen · Thaurock
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ER
Erosumika 7B v3 0.2 GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · logos-flux
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LL
Llama 3.1 8B Base Instruct SLERP
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
GLOBE Qwen2.5VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
RoleplayTool use
LL
LLaMA2 13B Tiefighter
Llama · bartowski
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
PI
L3-Picaro-8B
Picaro · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HU
Huihui LFM2.5 1.2B Instruct Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
kAI Bolt 0.8B
Qwen · Franci11
Params780M
Context256K
Q4_K_M0.6 GB
Vision
LL
Prox-Llama-3-8B-abliterated-orpo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
LL
ReWiz Llama 3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
QW
Qwen3 TTS
Qwen · Solidaxel
Params142M
Context32K
Smallest0.2 GB
GGUF
OP
opus v1.2 7b GGUF IQ Imatrix
Opus · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Qwen3 1.7B Uncensored
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF

Other quants

Keep browsing