F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · Vikhrmodels
Params494M
Context32K
Q4_K_M0.4 GB
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
LL
openchat-3.6-8b-20240522
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
TI
tinyllamas stories
Tinyllamas · klosax
Params134M
Context1K
Smallest0.0 GB
QW
Qwen3.5 9B
Qwen · prithivMLmods
Params8.95B
Context256K
Smallest9.5 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Litovation
Params638M
Context—
Q4_K_M0.5 GB
RF
rfdetr cpp nano
Rfdetr · mudler
Params30M
Context—
Smallest0.0 GB
MI
Mistral v0.3 7B ORPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
TI
tiny1m
Tiny · shibatch
Params—
Context256
Q4_K_M0.0 GB
MO
Moonshine Tiny (Arabic)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
NE
Next 1b
Next · thelamapi
Params1B
Context32K
Smallest1.1 GB
MI
Mistral Nemo Instruct 2407 13B
Mistral · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Samantha-Qwen-2-7B
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
ZE
ZeroTTS
Zerotts · zeroweight-ai
Params202M
Context—
Smallest0.1 GB
GL
GLM 4.6V Flash
GLM · prithivMLmods
Params9.4B
Context128K
Q4_K_M6.2 GB
QW
Qwen3 Code Reasoning 4B f32
Qwen · prithivMLmods
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 Thinking AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
PY
Pyxidis Manim CodeGen 1.7B
Pyxidis · prithivMLmods
Params1.72B
Context40K
Q4_K_M1.1 GB
RF
rfdetr cpp seg nano
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
RE
Replete LLM Mist Nemo 12b
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
OU
OuteTTS 0.2 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
UM
L3 Umbral Mind RP v3.0 8B
Umbral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
ekko v1 tiny
Parakeet · RyeAI
Params113M
Context—
Smallest0.1 GB
MI
Minitron 4B Base
Minitron · bartowski
Params4.19B
Context4K
Q4_K_M2.7 GB
HA
Hathor Tahsin L3 8B v0.9
Hathor · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dolphin-2.9.1-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
A.X 4.0 Light
Light · mykor
Params7.26B
Context16K
Q4_K_M4.4 GB
GE
Gemma 3 4b It
Gemma · chatpig
Params3.88B
Context128K
Q4_K_M2.5 GB