Tiny GGUF models

150 GGUF models in the Tiny family, quantized by 51 uploaders. Sizes run from 3M to 3.88B parameters. The longest trained context is 488K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
Tiny Emma I
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tiny-Knight-1.1b-v0.1
Tiny · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny Agent a 3B
Tiny · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
TI
Tiny OR1 Rust
Tiny · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingReasoning
TI
tiny-audio-tts
Tiny · mradermacher
Params663M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
TI
Tiny Lamina English
Tiny · mradermacher
Params52M
Context1K
Q4_K_M0.0 GB
Coding
TI
Tiny Agent a 0.5B
Tiny · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
TI
Tiny Lm 8M
Tiny · mradermacher
Params8M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tiny Emma I
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
zizi917/tiny-forward-lora
Tiny · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny DarkLlama i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny Audio
Tiny · mradermacher
Params172M
Context8K
Q4_K_M0.1 GB
GGUF
TI
Tiny Darkllama
Tiny · mrcuddle
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
Tiny DarkLlama3.2 1B Instruct v0.2
Tiny · mradermacher
Params1.03B
Context2K
Q4_K_M0.6 GB
GGUF
TI
batwan tiny aya
Tiny · alsersugasawa
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
TI
Tiny DarkLlama DPO SPIN Implementation
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny Stories Gpt2
Tiny · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
TI
Tiny-Vicuna-1B
Tiny · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny50M Multimix
Tiny · mradermacher
Params51M
Context2K
Q4_K_M0.0 GB
GGUF
TI
Tiny Pirate 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny Knight 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tiny random gpt2
Tiny · mradermacher
Params7M
Context1K
Q4_K_M0.0 GB
GGUF
TI
Tiny Moe
Tiny · mradermacher
Params148M
Context2K
Q4_K_M0.1 GB
GGUF
TI
LS Tiny Base
Tiny · Dsg2
Params20M
Context—
Q4_K_M0.0 GB
GGUF
TI
Tiny Vicuna 1b
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tiny aya global unlearn bio circuitkit 4bit aware
Tiny · itssaharsh
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
TI
Tiny DarkLlama SPIN Implementation
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Roleplay
TI
tiny aya kosher 3.3B
Tiny · EMD123
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
TI
tiny-audio-voice
Tiny · mradermacher
Params420M
Context125K
Q4_K_M0.3 GB
Tool use
TI
Tiny Viking 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing