Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
nomic-embed-text-v2-moe
Nomic · nomic-ai
Params475M
Context512
Q4_K_M0.3 GB
Embedding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
EC
Echo-TTS
Echo · dignome
Params2.77B
Context—
Smallest3.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · unsloth
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SO
Soprano 1.1 80M
Soprano · WalkingCat
Params80M
Context—
Smallest0.1 GB
GGUF
PA
Parakeet Ultra
Parakeet · handy-computer
Params627M
Context—
Q4_K_M0.5 GB
GGUF
QW
Models Qwen Qwen3 1.7B
Qwen · MaziyarPanahi
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
GGUF
NE
Nemotron 3 Diarization
Nemotron · audio-cpp
Params99M
Context—
Smallest0.1 GB
GGUF
QW
Ternary-Bonsai-2-4B
Qwen · prism-ml
Params782M
Context256K
Smallest0.9 GB
Vision
KI
kitten tts 2
Kitten · KittenML
Params1.73B
Context40K
Smallest1.0 GB
GGUF
BG
bge m3
BGE · gpustack
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
PA
.parakeet-ctc-1.1b.q8_0.gguf
Parakeet · nvidia
Params1.07B
Context—
Smallest1.2 GB
GGUF
ST
stories15M MOE
Stories · ggml-org
Params8M
Context256
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED DwarfStar Q2
DeepSeek · pyrodog
Params490M
Context—
Smallest1.0 GB
GGUF
QW
Qwen3.5 0.8B
Qwen · ggml-org
Params773M
Context256K
Smallest0.6 GB
Vision
FR
FrontTerrain-HARP-1B
Frontterrain · frontterrain
Params123M
Context512
Smallest0.2 GB
Coding
GE
Winnow 12B
Gemma · EldanRing
Params423M
Context256K
Smallest0.9 GB
Vision
WH
Whisper Small
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · bartowski
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SH
SheetSage2
Sheetsage · audio-cpp
Params677M
Context—
Smallest2.7 GB
GGUF
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GR
ibm granite granite 20b code instruct
Granite · RichardErkhov
Params1.9B
Context—
Q4_K_M0.0 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · lmstudio-community
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwen3.5-2B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · ggml-org
Params1.66B
Context1024K
Smallest1.4 GB
ReasoningTool useVision
GE
Gemma-3-1B-It
Gemma · unsloth
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
ST
stable diffusion v1 5
Stable · second-state
Params1.07B
Context—
Smallest1.6 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · SC117
Params447M
Context256K
Smallest14.3 GB
Vision
IN
WanVideo comfy
Infinitetalk · Kijai
Params2.49B
Context—
Q4_K_M1.4 GB
GGUF

Other sizes

Keep browsing