F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
PA
Parakeet Ultra
Parakeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
ST
L3-8B-Stheno-v3.2
Stheno · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
WH
Whisper Small
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
ST
stable diffusion v1 5
Stable · second-state
Params1.07B
Context—
Smallest1.6 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · bartowski
Params15.7B
Context160K
Q4_K_M10.4 GB
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
MU
multitalker parakeet streaming 0.6b v1
Multitalker · handy-computer
Params740M
Context—
Q4_K_M0.6 GB
OM
OmniVoice-tokenizer
Omnivoice · Serveurperso
Params613M
Context—
Q4_K_M0.3 GB
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
TE
test model stories260K
Test · ggml-org
Params—
Context—
Smallest0.0 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
CA
Canary 1B Flash
Canary · handy-computer
Params890M
Context—
Q4_K_M0.7 GB
US
RE USE
Use · audio-cpp
Params10M
Context—
Smallest0.0 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi 3.5 Mini Instruct
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
PA
parakeet primeline
Parakeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
TE
test model stories260K infill
Test · ggml-org
Params—
Context—
Smallest0.0 GB
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GI
GigaAM v3 E2E-CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
MI
Mistral Nemo Instruct 2407
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MX
mxbai embed xsmall v1
Mxbai · mixedbread-ai
Params24M
Context4K
Smallest0.0 GB
GE
gemma-2-9b-it
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Dolphin3.0 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
PA
Parakeet TDT 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB