F32 GGUF models

Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VisionCaption 2B
Qwen · prithivMLmods
Params1.72B
Context256K
Smallest1.8 GB
Vision
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
GE
Gemma 4 26B A4B It Qat
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Moonshine Base
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
LL
deepthought 8b llama v0.01 alpha
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 TTS 12Hz 0.6B
Qwen · BricksDisplay
Params661M
Context32K
Q4_K_M0.4 GB
GGUF
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
OL
Olmo 3 Think AIO
OLMo · prithivMLmods
Params32.2B
Context64K
Q4_K_M4.5 GB
Reasoning
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MO
Moonshine Tiny
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
NE
NeuTTS Nano
Neutts · BricksDisplay
Params262M
Context2K
Q4_K_M0.2 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
AC
AceInstruct 7B
Aceinstruct · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
VI
vibevoice
Vibevoice · gguf-org
Params2.7B
Context—
Q4_K_M3.5 GB
GGUF
EM
Emma 6 Hf
Emma · PaoloneSborracchione
Params1.55B
Context4K
Q4_K_M1.0 GB
Coding
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
HA
Hathor_Tahsin-L3-8B-v0.85
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
BT
btc chords
Btc · cstr
Params3M
Context—
Smallest0.0 GB
GGUF
BA
bagel
Bagel · calcuis
Params14.6B
Context—
Q4_K_M8.9 GB
GGUF
DO
Dolphin v2
Dolphin · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
CodingVision
FA
Falcon H1 1.5B Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
DE
DeciLM 7B instruct
Decilm · Deci
Params7.11B
Context8K
Smallest7.6 GB
GGUF
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
QW
Qwen.Qwen2.5 VL 3B Instruct
Qwen · DevQuasar-6
Params669M
Context125K
Q4_K_M1.9 GB
Vision
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
MA
Marco o1
Marco · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing