F32 GGUF models

Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
VI
MN Violet Lotus 12B
Violet · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
TA
tabcnn
Tabcnn · cstr
Params—
Context—
Smallest0.0 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
LL
Llama 3.1 8B Instruct
Llama · AI-Engine
Params8.03B
Context128K
Smallest3.2 GB
Tool use
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · HiddenViper229
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
CE
L3.1 8B Celeste V1.5
Celeste · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
PA
Pantheon Rp 1.5 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
GGUF
CS
CSM 1B
Csm · BricksDisplay
Params457M
Context—
Q4_K_M0.8 GB
GGUF
QW
MegaScience Qwen
Qwen · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
HO
HOT Step CPP SuperSep
Hot · scragnog
Params67M
Context—
Smallest0.3 GB
GGUF
OM
omnigen2
Omnigen · calcuis
Params3.97B
Context—
Q4_K_M6.0 GB
GGUF
OP
OpenThinker 7B
Openthinker · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OU
OuteTTS 1.0 0.6B
Outetts · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
GGUF
SU
SupraTitle 50M
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GGUF
GE
GEMMA SUTRA
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
Vision
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
GGUF
CH
Chandra
Chandra · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF

Other quants

Keep browsing