F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 7B rollercoaster v2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen Uncensored
Qwen · Xennon-BD
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
rtx5090 uncensored optimized qwen3 coder 30b a3b merged
Qwen · russlle2
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
LL
Hermes-2-Pro-Llama-3-8B
Llama · NousResearch
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwythos 9B Claude Mythos 5 1M MTP
Qwythos · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningTool useVision
AT
Athena zephyr 7B
Athena · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
GGUF
QW
RavenX Sec 8B
Qwen · deadbydawn101
Params8.2B
Context40K
Q4_K_M5.0 GB
Tool use
MP
Mpt 7b 8k
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
GGUF
MI
MathCoder2 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
QW
Qwen2.5 Coder 7B Instruct
Qwen · ThomasBaruzier
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
PA
parakeet ultra
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Reasoning
GE
Gemma 4 E2B It The DECKARD Expresso ONE Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningRoleplay
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
KE
Kestrel 4B Coder
Kestrel · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingReasoningTool use
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
XO
XORTRON.CriminalComputing.2026.4B.Instruct.NEXT
Xortron · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
TH
L3-TheSpice-8b-v0.8.3
Thespice · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ME
MediX R1 8B
Medix · MBZUAI
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
PA
PaddleOCR VL 1.6
Paddleocr · mradermacher
Params467M
Context128K
Q4_K_M0.3 GB
Vision
LC
lcm dreamshaper v7
Lcm · Steward
Params1.07B
Context—
Smallest2.1 GB
GGUF
AR
Arch Router 1.5B
Arch · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GU
Gumini 1B Base i1
Gumini · GuminiResearch
Params1.08B
Context32K
Q4_K_M0.7 GB
Tool use
HA
Hathor v4.6
Hathor · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepPresenter 9B
Deeppresenter · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
PH
Phi 3 mini 4k Python Vezora143k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 128k instruct abliterated v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

Other quants

Keep browsing