F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
PH
Phi 3.1 mini 128k instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
PA
Parakeet TDT-CTC 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
LL
Dolphin 3.0 Llama 3.2 1b
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
FI
Finch 7b
Finch · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
WH
whisper tiny
Whisper · FL33TW00D-HF
Params38M
Context—
Smallest0.0 GB
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
SI
Silero VAD v6.2
Silero · handy-computer
Params—
Context—
Smallest0.0 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
PA
Parakeet TDT-CTC 110M
Parakeet · handy-computer
Params114M
Context—
Q4_K_M0.1 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
FU
Fun CosyVoice3 0.5B 2512
Fun · Lourdle
Params859M
Context—
Q4_K_M0.6 GB
YI
Yi-1.5-9B-Chat
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
FL
flux model
Flux · licyk
Params11.9B
Context512
Q4_K_M2.9 GB
LA
speechbrain/lang-id-voxlingua107-ecapa
Lang · handy-computer
Params21M
Context—
Smallest0.0 GB
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
TE
tensor bank
Tensor · gguf-org
Params—
Context—
Q4_K_M0.0 GB