F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
VI
MN Violet Lotus 12B
Violet · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
TA
tabcnn
Tabcnn · cstr
Params—
Context—
Smallest0.0 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
LL
Llama 3.1 8B Instruct
Llama · AI-Engine
Params8.03B
Context128K
Smallest3.2 GB
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · HiddenViper229
Params8B
Context128K
Q4_K_M4.9 GB
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CE
L3.1 8B Celeste V1.5
Celeste · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
PA
Pantheon Rp 1.5 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
CS
CSM 1B
Csm · BricksDisplay
Params457M
Context—
Q4_K_M0.8 GB
QW
MegaScience Qwen
Qwen · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
HO
HOT Step CPP SuperSep
Hot · scragnog
Params67M
Context—
Smallest0.3 GB
OM
omnigen2
Omnigen · calcuis
Params3.97B
Context—
Q4_K_M6.0 GB
OP
OpenThinker 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
OU
OuteTTS 1.0 0.6B
Outetts · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 26B A4B It
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
CH
Chandra
Chandra · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB