F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
VO
VoxCPM-0.5B
Voxcpm · bluryar
Params728M
Context32K
Smallest0.5 GB
GGUF
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NA
Nanbeige4.1 3B
Nanbeige · mradermacher
Params3.93B
Context256K
Q4_K_M2.4 GB
GGUF
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
LI
LightOnOCR 2 1B
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
PH
Phi 3.5 Mini ChatML
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LI
LightOnOCR 2 1B Ocr Soup
Lightonocr · noctrex
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
ME
meta flores translation chinese english model
Meta · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
PA
Paraformer-zh
Paraformer · cstr
Params220M
Context—
Smallest0.1 GB
GGUF
MA
Magnum v4 9b
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CO
ContextualKunoichi KTO 7B
Contextualkunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
LL
Logical-elyza-llama2-7b-fast-instruct
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CodingRoleplay
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
VideoGuard Qwen3.5 9B Safety RL Uncensored
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
LF
LFM2 1.2B RAG
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
DO
Dolphin3 Cyber 8B
Dolphin · meowmeow123ok
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
MI
Dolphin3.0 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
GGUF
RW
rwkv 6 world 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
BE
Beepo 22B
Beepo · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
IN
InternVL3_5 8B
Internvl · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingVision
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
GGUF
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
VU
VulnLLM R 7B
Vulnllm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoning

Other quants

Keep browsing