F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
DI
diar streaming sortformer 4spk v2.1
Diar · handy-computer
Params118M
Context—
Smallest0.1 GB
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
LE
LeVo2
Levo · ckadirt
Params663M
Context—
Q4_K_M0.6 GB
HA
Hathor Sofit L3 8B v1
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniCPM O 2_6
MiniCPM · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
LL
FuseChat Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context32K
Q4_K_M4.7 GB
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
NeuTTS Air
Neutts · BricksDisplay
Params262M
Context—
Q4_K_M0.3 GB
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
YZ
yzma tests
Yzma · deadprogram
Params19M
Context8K
Smallest0.0 GB
TH
thinksound
Thinksound · ilintar
Params—
Context—
Smallest0.0 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
TE
text super resolution
Text · cstr
Params—
Context—
Smallest0.0 GB
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
DA
h2o-danube2-1.8b-chat
Danube · h2oai
Params1.83B
Context8K
Q4_K_M1.1 GB
TA
UI TARS 7B SFT
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
QW
shisa v2.1 qwen3 8b
Qwen · XpressAI
Params8.19B
Context40K
Q4_K_M5.0 GB