F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
GE
Gelato 30B A3B
Gelato · prithivMLmods
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Gliese Qwen3.5 0.8B Abliterated Caption
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
CD
FC CDM Poincare 7L 108M
Cdm · DuoNeural
Params108M
Context512
Q4_K_M0.1 GB
MI
MiniCPM V 4.6 Thinking Abliterated MAX
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
GE
survival uncensored gemma 270m
Gemma · pixasocial
Params268M
Context32K
Smallest0.3 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · backyardai
Params8B
Context32K
Q4_K_M4.9 GB
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
AL
all-MiniLM-L12-v2
All · leliuga
Params33M
Context512
Q4_K_M0.0 GB
LL
ArliAI-Llama-3-8B-Formax-v1.0
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
HE
G9v3 3B Heretic Abliterated
Heretic · Vortecks
Params3B
Context128K
Q4_K_M1.8 GB
GR
granite 34b code instruct
Granite · bartowski
Params33.7B
Context8K
Q4_K_M21.4 GB
OU
OuteTTS 0.3 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
QW
FuseChat Qwen 2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
LU
Lumimaid v0.2 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · Userb1az
Params30.5B
Context256K
Q4_K_M18.6 GB
LY
MN 12B Lyra v1
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
Moonshine Base (Korean)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GU
GA Guard AIO
Guard · prithivMLmods
Params4.02B
Context250K
Q4_K_M0.4 GB
IN
InternLM2
InternLM · lmstudio-community
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct
Qwen · zw89
Params3.09B
Context32K
Q4_K_M1.9 GB
CR
Crimson Dawn V0.1
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
FR
french-llm-from-scratch
French · vincent-pro-ai
Params320M
Context1K
Q4_K_M0.2 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
IN
Infinity Parser2 Flash
Infinity · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
PL
Plamo 2 Translate
Plamo · mitmul
Params9.53B
Context10240K
Q4_K_M6.3 GB
ST
MN 12B Starcannon v3
Starcannon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
OR
Orukeet
Orukeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB