F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
PH
Prox Phi 3 mini 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
LO
Loki v5.1
Loki · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
gpt 4o distil Llama 3.1 8B Instruct PaperWitch heresy
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
HA
Hare 1.1B Base 0.9v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
GE
Ru Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mistral 7B v0.2 ko Y24 v2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
JSL Med Phi 3.5 Mini v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GR
Granite 3.0 3b A800M Instruct
Granite · bartowski
Params3.37B
Context4K
Q4_K_M2.1 GB
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct heretic
SmolLM · saidutta69
Params1.71B
Context8K
Q4_K_M1.1 GB
AR
Aria CodeQwen stone
Aria · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
JE
Jebadiah 4b v2
Jebadiah · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
LL
Llama 3 Youko 8b Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
IN
Index Echo S2TT 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
MI
Minicpm5_1B_Agentic_Tooluse_Merged_Fp16_Ggufsafe
MiniCPM · ewin-reg
Params1.08B
Context128K
Q4_K_M0.7 GB
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
IN
Index Echo S2ST 9B
Index · IndexTeam
Params8.95B
Context256K
Q4_K_M5.6 GB