F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
LF
LFM3 1.7B Heretic Abliterated
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
TA
UI TARS 7B DPO
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 E2B It Uncensored MAX
Gemma · prithivMLmods
Params4.65B
Context128K
Smallest5.0 GB
NE
Nemomix v4.0 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
WH
Whisper Base (English)
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3.8 27B Humanlike Chat
Qwen · Guile
Params27B
Context256K
Q4_K_M16.6 GB
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GE
Tiger-Gemma-9B-v1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
dolphin-2.9.2-qwen2-7b
Qwen · dphn
Params7.62B
Context128K
Q4_K_M4.7 GB
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
LL
Meta Llama 3.1 8B Claude
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YU
Ruach Studio Models v2
Yue · goldhub
Params632M
Context32K
Q4_K_M4.7 GB
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
MO
MOSS TTS Realtime
Moss · BricksDisplay
Params2.08B
Context40K
Q4_K_M1.1 GB
RE
Replete-Coder-Instruct-8b-Merged
Replete · bartowski
Params8B
Context8K
Q4_K_M4.9 GB