F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B Shellsmith
Qwen · ajayk007
Params1.54B
Context32K
Smallest3.1 GB
Coding
TE
Bonsai JEV
Ternary · dakebakery
Params26.9B
Context—
Smallest0.2 GB
GGUF
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
CodingEmbedding
GE
Docto Decision Gemma 4 E4B Fr v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
MI
Pixtral 12B Ollama
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
ON
OneJev 0.8B
Onejev · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
MI
MiniCPM5-2B
MiniCPM · Mungert
Params2.52B
Context128K
Q4_K_M1.7 GB
CodingTool use
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
GGUF
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
GPT 5 Distill Qwen3 4B Instruct
Qwen · Jackrong
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LL
Impish_LLAMA_3B
Llama · l3utterfly
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwen3.5 4B Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
LL
Trendyol LLM 8b Chat v2.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3-8B-abliterated
Qwen · Mungert
Params8.2B
Context40K
Q4_K_M5.2 GB
GGUF
WH
Whisper Tiny (English)
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
CA
Carnice MoE 35B A3B APEX
Carnice · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
shisa v2.1 llama3.2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
GGUF
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
WR
writing roleplay 20k context nemo 12b v1.0
Writing · openerotica
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
DA
Darwin 36B Opus APEX
Darwin · mudler
Params34.7B
Context256K
Smallest11.5 GB
Reasoning
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
Reasoning
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
GR
granite 4.2 3b heretic
Granite · saidutta69
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningRoleplayTool use

Other quants

Keep browsing