Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
CR
CroissantLLMBase
Croissantllmbase · mradermacher
Params1.35B
Context2K
Q4_K_M0.9 GB
HA
Hare 1.1B Base 0.75v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
HE
HelpingAI Lite
Helpingai · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
EM
emma 5
Emma · MrMeOrYou
Params614M
Context2K
Q4_K_M0.4 GB
PY
Pythia 160m Deduped
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen2.5 1.5B Instruct uncensored i1
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · Andycurrent
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Granite 3.0 1b A400M Instruct
Granite · bartowski
Params1.33B
Context4K
Q4_K_M0.8 GB
LL
llama cpp python wheels
Llama · amukhinfly
Params3.09B
Context32K
Smallest3.3 GB
MI
MiniCPM5 2B
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context128K
Q4_K_M0.4 GB
LL
FuseChat Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
CH
CHEETAH 350M Merged
Cheetah · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Swift 1.5 Qwen3.8 Flash Next MTP for GGUF and NVFP4
Qwen · adriandj3
Params2.61B
Context256K
Smallest2.8 GB
DI
distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
TR
trollek LittleInstructionMaker 4B v0.1
Trollek · RichardErkhov
Params2.3B
Context8K
Q4_K_M2.4 GB
MA
Marx 3B v3
Marx · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · KingKassell
Params1.86B
Context—
Smallest0.9 GB
QW
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · khimaros
Params906M
Context—
Smallest1.3 GB
TI
TinyLlama Indo Chat v.02
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 0.5B Instruct
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
MI
MiniLoong-3B
Miniloong · mradermacher
Params3.02B
Context31K
Q4_K_M1.8 GB
GE
Gemma 2 2b Jpn It
Gemma · webbigdata
Params2.61B
Context8K
Q4_K_M1.7 GB
IN
Index Homura 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
SM
SMOLM2Prover
SmolLM · reaperdoesntknow
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB