Tiny GGUF models

150 GGUF models in the Tiny family, quantized by 51 uploaders. Sizes run from 3M to 3.88B parameters. The longest trained context is 488K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
Tiny Mpt Random Remote Code
Tiny · tensorblock
Params7M
Context2K
Smallest0.0 GB
Coding
TI
tiny aya global strategy agent
Tiny · HatemSaadallah
Params30M
Context—
Smallest0.1 GB
GGUF
TI
Tiny Urvashi v1.1
Tiny · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TI
Tiny Lamina Gheya
Tiny · mradermacher
Params153M
Context2K
Q4_K_M0.1 GB
GGUF
TI
Tiny Agent a 1.5B
Tiny · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
TI
Tiny Gpt2
Tiny · mradermacher
Params3M
Context32
Q4_K_M0.0 GB
GGUF
TI
Tiny Darkllama3.2 1B Instruct
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Roleplay
TI
Tiny Shakespeare Gpt1L
Tiny · mradermacher
Params14M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tiny DarkLlama Chat
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tiny json
Tiny · ChristianAzinn
Params494M
Context8K
Smallest0.1 GB
GGUF
TI
tiny starplanner
Tiny · mradermacher
Params164M
Context8K
Q4_K_M0.1 GB
GGUF
TI
Tiny Purr 350M Merged
Tiny · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
TI
Tiny Aya Earth
Tiny · mazrba
Params3.35B
Context488K
Q4_K_M2.4 GB
GGUF
TI
Tiny Urvashi v1
Tiny · mradermacher
Params1.66B
Context2K
Q4_K_M1.0 GB
GGUF
TI
Tiny Cowboy 1.1b v0.1
Tiny · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tiny aya atc q8 0
Tiny · sharonjohn
Params3.35B
Context8K
Smallest3.6 GB
GGUF
TI
Tiny Random Stablelm 2
Tiny · mradermacher
Params127M
Context4K
Q4_K_M0.1 GB
GGUF
TI
desi agent tinyaya sft lora
Tiny · ToolW
Params30M
Context—
Smallest0.1 GB
GGUF
TI
tiny aya sms extract
Tiny · Meowniece
Params3.35B
Context8K
Smallest3.6 GB
GGUF
TI
tiny aya wazuh analyst GGUF v2a
Tiny · Yusheng88
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
TI
Tiny DarkLlama
Tiny · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Tiny Knight 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tiny random stablelm
Tiny · tensorblock
Params35M
Context4K
Smallest0.0 GB
GGUF
TI
Tiny Random Stablelm 2
Tiny · mradermacher
Params127M
Context4K
Q4_K_M0.1 GB
GGUF
TI
tiny therapy
Tiny · BoscoTheDog
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tiny_llm_92m
Tiny · wdndev
Params92M
Context1K
Q4_K_M0.1 GB
GGUF
TI
tiny lm chat
Tiny · sixf0ur
Params14M
Context192
Smallest0.0 GB
GGUF
TI
Tiny Random Orion
Tiny · mradermacher
Params22M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tiny Pirate 1.1b v0.1 GGUF fp16
Tiny · phanerozoic
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tiny random BloomForCausalLM
Tiny · afrideva
Params—
Context7
Q4_K_M0.0 GB
GGUF

Keep browsing