F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen2 VL 2B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
IN
InverseCoder-DS-6.7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
FL
Flux 3 Image Klein Pup
Flux · ND911
Params8.95B
Context256K
Q4_K_M5.6 GB
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
WA
wan 1.3b
Wan · bykhan
Params127M
Context—
Q4_K_M1.0 GB
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.5 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
LongWriter Glm4 9b
GLM · bartowski
Params9.4B
Context1024K
Q4_K_M6.3 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
LF
LFM2 2.6B Transcript
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
FL
FLOR 1.3B Instructed
Flor · xaviviro
Params1.41B
Context4K
Q4_K_M0.9 GB
IN
Internlm3 8b Instruct
InternLM · bartowski
Params8.8B
Context32K
Q4_K_M5.4 GB
LL
Meta-Llama-3-8B-Instruct
Llama · qwp4w3hyb
Params8B
Context8K
Q4_K_M4.9 GB
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GA
GameScaling 2B S3
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
DE
DeepPresenter 9B
Deeppresenter · Forceless
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · ytu-ce-cosmos
Params8B
Context8K
Q4_K_M4.9 GB
DA
danube2-1.8b-CodeFeedback
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
QW
Replete LLM V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
AA
aac pictogram retriever ptbr
Aac · Papuguinho
Params155M
Context2K
Q4_K_M0.1 GB
ST
Step3 VL 10B
Step · seanbailey518
Params8.19B
Context64K
Q4_K_M5.0 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
AP
Apertus SEA LION v4 8B IT
Apertus · aisingapore
Params8.05B
Context64K
Q4_K_M5.1 GB
KA
KangalKhan RawRuby 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
OP
openPangu Embedded 7B V1.1
Openpangu · noctrex
Params8.03B
Context32K
Q4_K_M4.9 GB
WA
Wayra-Perplexity-Estimator-55M
Wayra · latam-gpt
Params55M
Context2K
Q4_K_M0.0 GB