F32 GGUF models
Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.
PA
Parakeet Unified EN 0.6B
Parakeet · anandlili951
Params618M
Context—
Q4_K_M0.5 GB
LL
llama.cpp
Llama · Tien203
Params6.74B
Context4K
Smallest3.8 GB
KI
Kimi-K2.6-DFlash-baseinit
Kimi · freakyskittle
Params3.48B
Context—
Smallest2.0 GB
LL
nano llama
Llama · jantxu
Params17M
Context512
Smallest0.0 GB
NO
Noesis Tiny Network
Noesis · dodle
Params—
Context—
Smallest0.0 GB
PA
Parakeet TDT 0.6B Japanese
Parakeet · Singla0009
Params623M
Context—
Smallest0.9 GB
GP
GPT 2
Gpt · ddh0
Params163M
Context1K
Smallest0.1 GB
SN
Snowflake Arctic Embed M
Snowflake · yixuan-chia
Params109M
Context512
Q4_K_M0.1 GB
GR
ibm-granite/granite-timeseries-ttm-r2
Granite · amaye15
Params—
Context512
Smallest0.0 GB
LL
LlamaThink 8B Instruct
Llama · DavidBrowne17
Params8.03B
Context128K
Q4_K_M4.9 GB
LO
LocalAI
Localai · FronkonGames
Params25M
Context—
Smallest0.1 GB
KA
Kapteyn 500M
Kapteyn · prithivMLmods
Params514M
Context8K
Q4_K_M0.3 GB
MI
mistral 7b instruct v0.2
Mistral · Migtito
Params7.24B
Context32K
Smallest7.7 GB
RW
rwkv7 g1 0.1b
Rwkv · latestissue
Params191M
Context1024K
Smallest0.1 GB
TI
tinyllama-1.1b-layla-v4
Tinyllama · l3utterfly
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
MAI UI 8B
Mai · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
AC
act aloha sim transfer cube
Act · ravediamond
Params34M
Context—
Smallest0.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · bonurb
Params7.25B
Context32K
Q4_K_M4.4 GB
TI
Tinytron 1B TinyLlama Instruct CODE Python Spanish English GGUF 16bit
Tinytron · Agnuxo
Params1.1B
Context2K
Smallest2.2 GB
TI
tinygemma1m
Tinygemma · shibatch
Params—
Context256
Q4_K_M0.0 GB
BA
babble
Babble · robloxianer
Params20M
Context64
Smallest0.0 GB
GP
GPT-Sw3-126M-Instruct-GGUF
Gpt · timpal0l
Params185M
Context2K
Smallest0.4 GB
GP
GPT-Sw3-356M-Instruct-GGUF
Gpt · timpal0l
Params435M
Context2K
Smallest0.9 GB
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
PA
Paraphrase Xlm R Multilingual v1
Paraphrase · mykor
Params277M
Context512
Q4_K_M0.2 GB
PA
Parakeet TDT-CTC 1.1B
Parakeet · epapanita
Params1.07B
Context—
Q4_K_M0.8 GB
CE
Celeste 12B V1.6
Celeste · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
DI
Distilgpt2
Distilgpt · shahzeb171
Params82M
Context1K
Smallest0.1 GB
MO
Moirai-1.0-R-large
Moirai · amaye15
Params308M
Context—
Smallest0.5 GB
LL
Llama 3.2 3B COTv2.2
Llama · ericflo
Params3.21B
Context128K
Q4_K_M2.0 GB