F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 4B Base
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
AB
Abel 7B 002
Abel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B TitanFusion
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TI
TinySlime-1.1B-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
MI
Hebrew Mistral 7B
Mistral · mradermacher
Params7.5B
Context32K
Q4_K_M4.6 GB
GGUF
GE
Gemma 4 E4B It Heretic
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingVision
ST
L3 SthenoMaid 8B V1
Sthenomaid · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Medichat-V2-Llama3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
FinGPT MT Llama 3 8B LoRA
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E2B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningRoleplay
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
QW
Qwen3.8 Whittle MoE 27B A17.8B GGUF all quants
Qwen · scima
Params26.9B
Context256K
Smallest11.3 GB
GGUF
SO
SOLAR 10.7B v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
GGUF
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
TeenyTinyLlama-Doc-160m
Llama · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen2.5 72B Instruct Abliterated
Qwen · Thaurock
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
GE
Rumeni 1 Nano
Gemma · kirilldual0987
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningVision
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
QwQ Unofficial 14B Math v0.2
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
VI
Vicuna 7b v1.3
Vicuna · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
FI
fireredtts3
Fireredtts · cstr
Params2.12B
Context—
Smallest1.1 GB
GGUF
CH
Chandra
Chandra · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
KA
Kainatbinary rp 7b
Kainatbinary · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay

Other quants

Keep browsing