F32 GGUF models

Unquantized 32-bit floats. Rarely needed for running a model. 2087 models have a F32 file. Sizes run from 1M to 310B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2-7B-Instruct-deccp
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Kudzu-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PI
piano transcription
Piano · cstr
Params39M
Context—
Smallest0.1 GB
GGUF
LL
Ollama Video llama 7B
Llama · ManishThota
Params6.74B
Context4K
Smallest13.5 GB
Vision
QW
Qwen2.5 7B Instruct 1M
Qwen · BabaK07
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
QW
Qwen3-TTS-Tokenizer-12Hz
Qwen · ldov
Params915M
Context—
Q4_K_M0.3 GB
GGUF
LL
LLM AI Server
Llm · mmkurodan
Params2M
Context128
Q4_K_M0.0 GB
GGUF
VI
VibeThinker 3B Heretic_Decensored
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
BR
BreezyVoice LM
Breezyvoice · BricksDisplay
Params382M
Context8K
Q4_K_M0.2 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · FILM6912
Params2B
Context—
Smallest1.3 GB
GGUF
MM
mmBERT Base
Mmbert · mykor
Params307M
Context8K
Q4_K_M0.2 GB
GGUF
MO
Moonshine Tiny (Vietnamese)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 0.8B Opus 4.6 Reasoning
Qwen · NhZtw
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
BG
bge-base-zh-v1.5
BGE · CompendiumLabs
Params102M
Context512
Q4_K_M0.1 GB
Embedding
GR
GRMR 2B Instruct
Grmr · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
mini magnum 12b v1.1
Mini · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RY
RynnBrain1.1 2B
Rynnbrain · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
CodingReasoningTool use
EM
embeddinggemma 300m GGUF with dense modules
Embeddinggemma · cduk
Params308M
Context2K
Smallest0.2 GB
Embedding
LO
LoafLM 10M GPT2 F32
Loaflm · exnivo
Params10M
Context128
Smallest0.0 GB
Coding
BA
basic-pitch
Basic · cstr
Params—
Context—
Smallest0.0 GB
GGUF
JU
Julia-1
Julia · andrelucas
Params144M
Context8K
Smallest0.3 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · prithivMLmods
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
CO
Confucius O1 14B
Confucius · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MO
sumi-ja-pii
Modernbert · NagaYu
Params132M
Context8K
Smallest0.5 GB
GGUF
QW
Qwen2.5 3B
Qwen · EasierAI
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
TH
L3.1 TheGreenLion 8b SFT v0.1.2
Thegreenlion · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TW
TwinLlama 3.1 8B 2
Twinllama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM2.5 2.6B
Lfm · prithivMLmods
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool use
RF
rfdetr cpp seg small
Rfdetr · mudler
Params34M
Context—
Smallest0.0 GB
GGUF

Other quants

Keep browsing