F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Abliterated v2 MAX
Qwen · prithivMLmods
Params26.9B
Context256K
Smallest28.6 GB
QW
Qwen3.5 4B
Qwen · prithivMLmods
Params4.21B
Context256K
Smallest4.5 GB
UM
L3 Umbral Mind RP v3.0 8B
Umbral · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
KA
KAIL F2
Kail · Kaniskten
Params1.12B
Context128K
Q4_K_M0.8 GB
SM
Lattice 4E Lorentz Holographic 253M Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen3 VL 2B Instruct
Qwen · prithivMLmods
Params1.72B
Context256K
Smallest1.8 GB
AR
Arcee-Nova
Arcee · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
gguf Llama 160M Chat v1
Llama · Felladrin
Params162M
Context2K
Smallest0.1 GB
TO
Datadog/Toto-2.0-4m
Toto · amaye15
Params1.04B
Context—
Smallest0.0 GB
AR
Arch Router 1.5B
Arch · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 0.6B
Qwen · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
RE
replit code 1.5
Replit · modularai
Params3.32B
Context4K
Smallest6.6 GB
MA
mallam 1.1b 20k instructions v2
Mallam · prsyahmi
Params1.12B
Context32K
Q4_K_M0.7 GB
TH
Theia 21B v1
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
NL
nllb 200 distilled 600M
Nllb · JaydeepGupta
Params616M
Context1K
Smallest1.0 GB
QW
Muscae Qwen3 UI Code 4B
Qwen · prithivMLmods
Params4.02B
Context256K
Q4_K_M2.5 GB
TA
TAIDE LX 7B Chat
Taide · nctu6
Params6.94B
Context4K
Q4_K_M4.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · stratalab-org
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
UI
UIGEN X 4B 0729 f32
Uigen · prithivMLmods
Params4.02B
Context40K
Q4_K_M2.5 GB
IN
InternLM2
InternLM · bartowski
Params7.74B
Context8K
Q4_K_M4.7 GB
NA
Nanbeige4.1 3B
Nanbeige · Trisert
Params3.93B
Context256K
Q4_K_M2.4 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Robert-Finance
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
japanese mistral 300m base
Mistral · ce-lery
Params355M
Context4K
Smallest1.4 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Luna f32
Luna · prithivMLmods
Params4.02B
Context256K
Q4_K_M2.5 GB
EU
EuroMoE 2.6B A0.6B Preview
Euromoe · nyuuzyou
Params2.61B
Context4K
Q4_K_M1.6 GB
BG
bge m3
BGE · mykor
Params567M
Context8K
Q4_K_M0.4 GB
BE
bert base NER
Bert · cstr
Params108M
Context512
Smallest0.0 GB