F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
LF
LFM2.5 Audio 1.5B GGUF LEAP
Lfm · LiquidAI
Params1.17B
Context—
Smallest0.1 GB
GGUF
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
GGUF
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
Vision
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Minicpm
MiniCPM · trithemius
Params34.7B
Context256K
Smallest15.5 GB
ReasoningTool useVision
AY
Aya Expanse 8b
Aya · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
PA
Parakeet TDT-CTC 110M
Parakeet · handy-computer
Params114M
Context—
Q4_K_M0.1 GB
GGUF
GE
Gemma 4 E4B
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
Vision
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
RW
Rwkv 6 World 7b
Rwkv · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
GGUF
FI
FinanceGemma E4B
Financegemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
QW
qwen image 2.1
Qwen · gguf-org
Params338M
Context256K
Q4_K_M5.0 GB
Vision
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
LL
llm4decompile 9b v2
Llm · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Huihui Gemma 4 E4B It Abliterated
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
FL
flux2 klein
Flux · ChrisColeTech
Params9.08B
Context40K
Q4_K_M5.0 GB
Vision
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
SZ
SZL Khipu 1.5B
Szl · SZLHOLDINGS
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
JI
Jina Embeddings v5 Text Small Classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · Orenguteng
Params8B
Context128K
Smallest4.7 GB
GGUF
NE
nexus legal
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 0.6B Base
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GGUF

Other quants

Keep browsing