F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM V 4.6 Heretic
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
VI
mythos fast
Vibethinker · Shadow0482
Params3.1B
Context128K
Q4_K_M1.9 GB
Tool use
PR
Prismatic 12b
Prismatic · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
IR
Irodori-TTS-v4.1-Small
Irodori · sakasegawa
Params859M
Context—
Smallest0.9 GB
GGUF
GE
Gemma 3 4b Persian v0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
GGUF
YI
Hermes-2.5-Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Tool use
LL
Configurable-Hermes-2-Pro-Llama-3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
NE
Negentropy Claude Opus 4.7 9B
Negentropy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TA
tabcnn
Tabcnn · cstr
Params—
Context—
Smallest0.0 GB
GGUF
HU
hyvid i2v
Hunyuanvideo · calcuis
Params123M
Context—
Q4_K_M7.7 GB
GGUF
DE
Andy 4
DeepSeek · Sweaterdog
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
bangla-llama-7b-instruct-v0.1
Llama · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
GE
gemma 4 E4B Agentic Sol Fable Reasoning GeminiCLI
Gemma · deadbydawn101
Params7.5B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemopus 4 E4B It
Gemopus · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningVision
TI
TiamaPY-1.1B-v24
Tiamapy · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
KA
kagemusya-7B-v1
Kagemusya · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Qwen3Vl 235b A22B Thinking
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
PY
Pyrex 8B Instruct Uncensored
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
Mamba 130m Hf
Mamba · mradermacher
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · tiiuae
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
RE
RA Reasoner
Reasoner · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FO
Foundation Sec 8B Instruct Heretic
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
Moistral 11B v3
Moistral · BeaverLegacy
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.1_OpenScholar 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GW
gwen2 coder
Gwen · harryng4869
Params7.62B
Context128K
Smallest15.2 GB
Coding
GE
Gemma 3 4b It
Gemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
IN
InRanker Base
Inranker · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
LL
Llama SmolTalk 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF

Other quants

Keep browsing