F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
KI
Kimodo-G1-RP-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GE
Gemma 2 Ataraxy 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
Nemotron 3.5 Embed 1B BF16
Nemotron · W4D
Params1.14B
Context256K
Q4_K_M0.7 GB
VL
VLX Seek 1.5 10B
Vlx · Asher-1
Params1.1B
Context—
Smallest0.0 GB
FA
Falcon H1 7B Instruct
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
LL
LLaVA-NeXT-Video-7B-DPO
LLaVA · ManishThota
Params6.74B
Context4K
Smallest7.2 GB
MO
Moonshine Streaming Tiny
Moonshine · handy-computer
Params44M
Context—
Smallest0.1 GB
KI
Kimodo-SOMA-SEED-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
MA
magpie tts.cpp
Magpie · mudler
Params347M
Context—
Smallest0.5 GB
LF
LFM2 350M ENJP MT
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GE
NVIDIA GEM-X SOMA regression denoiser
Gem · LocalAI-io
Params44M
Context120
Smallest0.2 GB
MI
Mistral Small 24B Base 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
YU
Yue2-3B-GGUF
Yue · tungnguyen84
Params677M
Context—
Smallest0.3 GB
NO
nomic-embed-code
Nomic · nomic-ai
Params7.1B
Context32K
Q4_K_M4.4 GB
CH
Chatterbox Multilingual TTS
Chatterbox · BricksDisplay
Params506M
Context—
Q4_K_M0.2 GB
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
WH
Whisper Tiny (English)
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
VO
VoxCPM-0.5B
Voxcpm · bluryar
Params728M
Context32K
Smallest0.5 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · noctrex
Params1.72B
Context256K
Q4_K_M1.1 GB
RE
Replete LLM Mist Nemo 12b test merged 250k
Replete · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
RW
rwkv 6 world 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
IN
Internlm3 8b Instruct
InternLM · bartowski
Params8.8B
Context32K
Q4_K_M5.4 GB
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
WA
Wayra-Perplexity-Estimator-55M
Wayra · latam-gpt
Params55M
Context2K
Q4_K_M0.0 GB
FU
functionary small v3.2
Functionary · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB