F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
godot gemma 4 e4b it
Gemma · bekoozkan
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingVision
QW
Qwen2.5 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MU
Murasaki Backup
Murasaki · shoutmon
Params14.8B
Context32K
Smallest3.6 GB
GGUF
AI
Aiaudiotranslate
Aiaudiotranslate · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
LL
Llama 3.2 3B Instruct Heretic Ablitered Uncensored
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
IN
InternVL3 8B Instruct
Internvl · ggml-org
Params7.61B
Context32K
Q4_K_M4.7 GB
Vision
TO
ToriiGate v0.4 7B
Toriigate · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen3 1.7B Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · Lewdiculous
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
QW
Qwen3.5 9B Harmonic
Qwen · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
GGUF
CO
confucius4 tts
Confucius · cstr
Params112M
Context—
Smallest0.1 GB
GGUF
MI
MiniCPM V 2 6
MiniCPM · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
CodingVision
QW
PopiT Qwen3 4B Medical SFT 1128
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
PA
Parakeet TDT 0.6B v2 English Hebrew Codeswitching
Parakeet · danielrosehill
Params618M
Context—
Q4_K_M0.5 GB
Coding
SE
SenseVoiceSmall
Sensevoicesmall · cstr
Params234M
Context—
Smallest0.1 GB
GGUF
GE
gemmuguinho 636m
Gemmuguinho · Papuguinho
Params636M
Context32K
Q4_K_M0.5 GB
GGUF
ST
stable diffusion 3.5 medium
Stable · city96
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
QW
Qwen3.6 27B abliterated
Qwen · wangzhang
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
MiniCPM5-2B-Claude-Fable5-1-Thinking
MiniCPM · GnLOLot
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B
DeepSeek · DavidAU
Params4.1B
Context128K
Q4_K_M2.5 GB
Reasoning
QW
dnotitia_Smoothie Qwen3 4B
Qwen · Alcoft
Params4B
Context40K
Q4_K_M2.4 GB
Reasoning
LU
Lumimaid Magnum v4 12B
Lumimaid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen3 VL 4B Instruct Uncensored
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision

Other quants

Keep browsing