F32 GGUF models

Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
GGUF
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LF
LFM3 1.7B Heretic Abliterated
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
CodingVision
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
Vision
TA
UI TARS 7B DPO
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
GE
Gemma 4 E2B It Uncensored MAX
Gemma · prithivMLmods
Params4.65B
Context128K
Smallest5.0 GB
ReasoningVision
NE
Nemomix v4.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
WH
Whisper Base (English)
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GGUF
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat
Qwen · Guile
Params27B
Context256K
Q4_K_M16.6 GB
Roleplay
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
dolphin-2.9.2-qwen2-7b
Qwen · dphn
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
Embedding
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
Coding
LL
Meta Llama 3.1 8B Claude
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
YU
Ruach Studio Models v2
Yue · goldhub
Params632M
Context32K
Q4_K_M4.7 GB
Vision
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
MO
MOSS TTS Realtime
Moss · BricksDisplay
Params2.08B
Context40K
Q4_K_M1.1 GB
GGUF
RE
Replete-Coder-Instruct-8b-Merged
Replete · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
Coding

Other quants

Keep browsing