F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Uncensored
Qwen · orcarouter
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 12b It Uncensored
Gemma · zaakirio
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
WA
LiveAvatar
Wan · audio-cpp
Params16.3B
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Q4_K_M16.6 GB
ReasoningRoleplayTool use
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
GGUF
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
Vision
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.5 9B Abliterated
Qwen · lukey03
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
Vision
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 VL 7B Instruct
Qwen · ggml-org
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
QW
qmd query expansion 1.7B
Qwen · tobil
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
SO
sopro v2 turbo
Sopro · samuel-vitorino
Params158M
Context—
Smallest0.3 GB
GGUF
GI
GigaAM v3 E2E-RNN-T
Gigaam · handy-computer
Params223M
Context—
Q4_K_M0.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
XI
Xing4.0 29B A4B
Xing · Venastine-Research
Params31.2B
Context256K
Q4_K_M19.0 GB
Coding
OP
openthaigpt1.5 7b instruct
Openthaigpt · openthaigpt
Params7.62B
Context32K
Smallest3.8 GB
GGUF
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
Embedding
QW
Qwen3Vl 30b A3B Instruct
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
FU
Fun-ASR-Nano-2512-hf-854d88f
Fun · FunAudioLLM
Params—
Context—
Smallest1.0 GB
GGUF
EC
Echo-TTS
Echo · dignome
Params2.77B
Context—
Smallest3.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · unsloth
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
Vision

Other quants

Keep browsing