F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
MO
MOSS-Transcribe-Diarize 0.9B
Moss · handy-computer
Params909M
Context—
Q4_K_M0.6 GB
PA
Parakeet RNN-T 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GR
TwIL LM3 Pro
Granite · webAI-Official
Params3.66B
Context128K
Q4_K_M2.2 GB
HU
HunyuanOCR
Hunyuanocr · prithivMLmods
Params539M
Context128K
Q4_K_M0.4 GB
MA
MN 12B Mag Mell R1
Mag · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HU
Hunyuan-MT-7B
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
QW
Qwen2.5-14B-Instruct-1M
Qwen · Mungert
Params14.8B
Context986K
Q4_K_M9.2 GB
QW
qwen3 tts 1.7b customvoice
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
PA
Parakeet RNN-T 0.6B
Parakeet · handy-computer
Params617M
Context—
Q4_K_M0.5 GB
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
TI
TIPO v2.1 1B A200M
Tipo · KBlueLeaf
Params1.01B
Context4K
Smallest1.1 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Assistant
Gemma · RachidAR
Params420M
Context128K
Smallest0.2 GB
PA
Parakeet CTC 1.1B
Parakeet · handy-computer
Params1.06B
Context—
Q4_K_M0.8 GB
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · DoorZekor
Params16.4B
Context—
Q4_K_M10.8 GB
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB