F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Prox Phi 3 mini 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
Vision
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LO
Loki v5.1
Loki · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
HA
Hare 1.1B Base 0.9v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
GGUF
GE
Ru Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mistral 7B v0.2 ko Y24 v2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
JSL Med Phi 3.5 Mini v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GR
Granite 3.0 3b A800M Instruct
Granite · bartowski
Params3.37B
Context4K
Q4_K_M2.1 GB
GGUF
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
GGUF
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
SM
SmolLM2 1.7B Instruct heretic
SmolLM · saidutta69
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
AR
Aria CodeQwen stone
Aria · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
JE
Jebadiah 4b v2
Jebadiah · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Index Echo S2TT 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Minicpm5_1B_Agentic_Tooluse_Merged_Fp16_Ggufsafe
MiniCPM · ewin-reg
Params1.08B
Context128K
Q4_K_M0.7 GB
Tool use
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
Index Echo S2ST 9B
Index · IndexTeam
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Other quants

Keep browsing