F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
PA
Parakeet RNN-T 0.6B
Parakeet · handy-computer
Params617M
Context—
Q4_K_M0.5 GB
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
PA
Parakeet CTC 1.1B
Parakeet · handy-computer
Params1.06B
Context—
Q4_K_M0.8 GB
LU
L3-8B-Lunaris-v1
Lunaris · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
MI
Dolphin3.0 R1 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · prithivMLmods
Params8.95B
Context256K
Smallest9.5 GB
MO
Moonshine Streaming Small
Moonshine · handy-computer
Params140M
Context—
Smallest0.2 GB
VI
Violet Twilight v0.2
Violet · Epiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
NeuralLemon 7B
Neurallemon · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
ltxv0.9.6
Ltx · calcuis
Params1.92B
Context—
Q4_K_M1.4 GB
AC
ace
Ace · calcuis
Params3.31B
Context—
Q4_K_M0.1 GB
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ST
stable-audio-3-medium SAME-L
Stable · thepatch
Params—
Context—
Q4_K_M0.6 GB
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO DFlash
Qwen · hotocooo
Params1.34B
Context256K
Q4_K_M0.8 GB
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
WH
Whisper Tiny
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
CH
chatterbox
Chatterbox · calcuis
Params264M
Context—
Q4_K_M0.3 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YU
quantized-yue2-3b
Yue · ngquocvinh
Params3.63B
Context—
Q4_K_M2.9 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Meta Llama 3.1 8B Instruct
Llama · modularai
Params8B
Context128K
Q4_K_M4.9 GB