F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.2 1b
Llama · callgg
Params1.24B
Context128K
Q4_K_M0.8 GB
LF
LFM2.5 230M
Lfm · prithivMLmods
Params230M
Context125K
Q4_K_M0.2 GB
SQ
sqlite lembed model examples
Sqlite · asg017
Params23M
Context512
Smallest0.0 GB
GG
ggml CLIP ViT H 14 laion2B s32B b79K
Ggml · mys
Params986M
Context—
Smallest0.2 GB
OP
OpenCaption 2B VL SFT v1.0
Opencaption · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
LL
Meta Llama 3.1 8B Instruct
Llama · starshina3003
Params8.03B
Context128K
Q4_K_M4.9 GB
AR
Quark 270m Base
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
DI
dia
Dia · calcuis
Params1.61B
Context—
Smallest2.6 GB
QW
Gliese Qwen3.5 2B Abliterated Caption
Qwen · prithivMLmods
Params1.88B
Context256K
Smallest2.0 GB
RN
Rnj 1 Instruct Heretic
Rnj · ZuzeTt
Params8.31B
Context32K
Q4_K_M5.1 GB
LL
Hermes 3 Llama 3.1 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chatterbox Turbo
Chatterbox · BricksDisplay
Params333M
Context—
Q4_K_M0.2 GB
SE
Seeker 9b
Seeker · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
MI
Midm 2.0 Base Instruct
Midm · mykor
Params11.5B
Context32K
Q4_K_M7.0 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · bartowski
Params34.4B
Context8K
Q4_K_M20.7 GB
LI
lightonai/LightOnOCR-3-0.8B
Lightonocr · tomngdev
Params752M
Context256K
Q4_K_M0.5 GB
TA
TAID LLM 1.5B
Taid · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
BU
BUT FIT_csmpt7b
But · BUT-FIT
Params6.7B
Context2K
Smallest7.1 GB
QW
Qwen3 8B
Qwen · prithivMLmods
Params8.19B
Context40K
Q4_K_M5.0 GB
EX
Exaone 3.0 7.8b It
Exaone · Bingsu
Params7.82B
Context4K
Q4_K_M4.8 GB
LL
Llama Nemotron Embed 1b v2
Llama · mykor
Params1.24B
Context128K
Q4_K_M0.8 GB
YI
Yi-1.5-34B-Chat
Yi · bartowski
Params34.4B
Context4K
Q4_K_M20.7 GB
ON
onsets and frames
Onsets · cstr
Params27M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg 2xlarge
Rfdetr · mudler
Params38M
Context—
Smallest0.0 GB
LL
CodeLlama-7B-KStack
Llama · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
SE
Senku-70B-Full
Senku · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
DU
Dusk_Rainbow
Dusk · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
LL
Hermes 3 Llama 3.2 3B f32
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
RF
rfdetr cpp seg large
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB