F32 GGUF models

Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
SenseVoice Small
Sensevoicesmall · handy-computer
Params234M
Context—
Q4_K_M0.1 GB
GGUF
LF
LFM2.5 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
Vision
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
GGUF
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GGUF
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB
GGUF
LA
LatentSync 1.6
Latentsync · audio-cpp
Params1.37B
Context—
Smallest2.1 GB
GGUF
KI
Kimodo-SOMA-RP-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
GGUF
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
Embedding
LL
Hermes 3 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
WH
Whisper Medium (English)
Whisper · handy-computer
Params764M
Context—
Q4_K_M0.5 GB
GGUF
CA
Canary 1B
Canary · handy-computer
Params1.02B
Context—
Q4_K_M0.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Dolphin 3.0 Llama 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
MO
Moonshine Streaming Medium
Moonshine · handy-computer
Params266M
Context—
Smallest0.3 GB
GGUF
WH
Whisper Base
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GGUF
QW
Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
Embedding
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PA
Parakeet RNN-T 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · prithivMLmods
Params539M
Context128K
Q4_K_M0.4 GB
Vision
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
MI
Mistral-7B-Instruct-v0.3
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing