F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
bge-small-en-v1.5
BGE · CompendiumLabs
Params33M
Context512
Q4_K_M0.0 GB
Embedding
QW
Qwen3 Embedding 0.6b
Qwen · Qwen
Params596M
Context32K
Smallest0.6 GB
Embedding
LL
Llama 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
IM
Z Image
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
AL
all-MiniLM-L6-v2
All · second-state
Params23M
Context512
Q4_K_M0.0 GB
Embedding
AL
all-MiniLM-L6-v2
All · leliuga
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
MI
Voxtral Small 24B
Mistral · handy-computer
Params24.3B
Context—
Q4_K_M14.3 GB
GGUF
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision
QW
Qwen2.5 Omni 7B
Qwen · ggml-org
Params7.6B
Context32K
Q4_K_M4.7 GB
Vision
TA
UI-TARS-1.5-7B
Tars · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
GE
gemma 4 E4B it qat
Gemma · unsloth
Params93M
Context128K
Smallest0.1 GB
Vision
FL
FLUX.1 schnell
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
SN
snowflake arctic embed m v1.5
Snowflake · Snowflake
Params109M
Context512
Smallest0.1 GB
Embedding
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
BG
bge-large-en-v1.5
BGE · CompendiumLabs
Params334M
Context512
Q4_K_M0.2 GB
Embedding
QW
Qwen3 1.7B
Qwen · ggml-org
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen2.5 VL 3B Instruct
Qwen · ggml-org
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
WA
Wan2.1 14B VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
BG
bge-base-en-v1.5
BGE · CompendiumLabs
Params109M
Context512
Q4_K_M0.1 GB
Embedding
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
GR
Granite 4.2 3B BE
Granite · taronaeo
Params3.66B
Context—
Q4_K_M2.2 GB
ReasoningTool use
TE
test model router download
Test · ggml-org
Params1M
Context2K
Smallest0.0 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · openbmb
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
SU
Supra2 100M Instruct
Supra · SupraLabs
Params101M
Context2K
Smallest0.2 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · LiquidAI
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
CA
Canary 1B v2
Canary · handy-computer
Params980M
Context—
Q4_K_M0.7 GB
GGUF
MI
MiniCPM o 4 5
MiniCPM · openbmb
Params8.2B
Context40K
Q4_K_M5.0 GB
Vision

Other quants

Keep browsing