F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
FL
FLUX.1 schnell
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
LL
CreativeWriter Llama3.2 3B
Llama · theprint
Params3.21B
Context128K
Q4_K_M2.0 GB
MU
multitalker parakeet streaming 0.6b v1
Multitalker · handy-computer
Params740M
Context—
Q4_K_M0.6 GB
LL
Llama 3.2 3B Instruct
Llama · bartowski
Params3.61B
Context128K
Q4_K_M2.2 GB
DG
dgpl experimental 1
Dgpl · dgpl
Params550M
Context—
Q4_K_M0.3 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Embedding 8B
Qwen · Qwen
Params7.57B
Context40K
Q4_K_M4.7 GB
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
GR
Granite Speech 4.1 2B NAR
Granite · handy-computer
Params2.25B
Context—
Q4_K_M1.6 GB
LL
Llama-3.2-1B-Instruct
Llama · unsloth
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
D1
d1 3B
LiquidAI
Params2.7B
Context32K
Q4_K_M1.7 GB
FL
FLUX.1 dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M6.9 GB
QW
Qwen2.5 VL 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
MiniCPM V 4 5
MiniCPM · openbmb
Params8.2B
Context40K
Q4_K_M5.0 GB
MU
MuScriptor Small
Muscriptor · DamRsn
Params1.37B
Context—
Smallest0.2 GB
GR
Granite Speech 4.1 2B
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
MI
mistralai_Devstral Small 2 24B Instruct 2512
Mistral · lmstudio-community
Params23.6B
Context384K
Q4_K_M14.3 GB
FU
Fun ASR MLT Nano 2512
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
LT
LTX 2
Ltx · unsloth
Params18.9B
Context—
Q4_K_M12.8 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
TR
Translategemma 4b It
Translategemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
Deepseek-R1-Distill-Llama-70B
DeepSeek · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma-4-E2B-It
Gemma · ente-ai
Params4.65B
Context128K
Q4_K_M3.1 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · ggml-org
Params1.81B
Context8K
Q4_K_M1.1 GB
LF
LFM3 Omni 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB