F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
SE
SenseVoice Small
Sensevoicesmall · handy-computer
Params234M
Context—
Q4_K_M0.1 GB
LF
LFM2.5 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB
LA
LatentSync 1.6
Latentsync · audio-cpp
Params1.37B
Context—
Smallest2.1 GB
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
LL
Hermes 3 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
WH
Whisper Medium (English)
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
CA
Canary 1B
Canary · handy-computer
Params1.02B
Context—
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
Moonshine Streaming Medium
Moonshine · handy-computer
Params266M
Context—
Smallest0.3 GB
WH
Whisper Base
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
QW
Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
PA
Parakeet RNN-T 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
HU
HunyuanOCR
Hunyuanocr · prithivMLmods
Params539M
Context128K
Q4_K_M0.4 GB
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB