F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
SW
SwedishBeagle-dare
Swedishbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
NO
Nova-v3
Nova · plasmova
Params170M
Context2K
Smallest0.3 GB
Coding
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
WA
wav2vec2 large xlsr 53 chinese zh cn
Wav · cstr
Params319M
Context—
Smallest0.2 GB
GGUF
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingEmbedding
QW
Qwen3 ASR 1.7B Uncensored
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
GE
Darkidol Gemma 4 E2B It
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
ST
stable-audio-3-small-sfx SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
GGUF
SA
Sarashina2.2 0.5b
Sarashina · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
LL
Meta Llama 3.1 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mica v0.5 4B
Mica · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
TU
uf tulu 2 7b dpo full
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
QW
Replete-Coder-Qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
LA
ecapa lid 107
Lang · cstr
Params21M
Context—
Smallest0.0 GB
GGUF
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Claude Oss Merged Hf
Qwen · squ11z1
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
Qwen3.5 9b Nsfw Captioning v3
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
LF
LFM2.5 8B A1B Coder
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
MI
chronos mistral 7b
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
Vision
KA
Karnak-6B-v1.0
Karnak · mradermacher
Params5.94B
Context256K
Q4_K_M3.7 GB
GGUF
QU
Quest AI quest corruption 7b s375 v3 GRPO
Quest · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
PE
PentaCoder 9B
Pentacoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
OneLLM Doey ChatQA V1 Llama 3.2 1B
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Other quants

Keep browsing