Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LMF 2.5 2B Code
Lfm · bunnycore
Params2.7B
Context128K
Smallest1.9 GB
Coding
TH
Thaki ASR KO Dialects v1 i1
Thaki · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
GGUF
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · unsloth
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool use
DO
DoItYourself v1 2B
Doityourself · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
ST
StartLux-Decision-v1.1-0.8B-Instant
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
Vision
ST
stablelm zephyr 3b
Stablelm · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
SM
SmolVLM Instruct
Smolvlm · ggml-org
Params1.81B
Context16K
Q4_K_M1.1 GB
Vision
LF
LFM2 1.2B Tool
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
OP
OpenCoder 1.5B Instruct
Opencoder · lmstudio-community
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
MO
moss tts v1.5
Moss · cstr
Params1.77B
Context—
Smallest3.5 GB
GGUF
HY
HY MT1.5 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
ME
mel band roformer vocals
Mel · cstr
Params228M
Context—
Smallest0.5 GB
GGUF
MO
Moonshine Streaming Tiny
Moonshine · handy-computer
Params44M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3.8 27B NVFP4 MTP SSMFIX
Qwen · esatapedico
Params461M
Context256K
Smallest14.9 GB
Vision
MI
MinerU2.5 Pro 2605 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
Vision
LF
LFM2.5 1.2B Instruct DSpark Draft v1
Lfm · LiquidAI
Params296M
Context125K
Q4_K_M0.2 GB
GGUF
OP
OpenCodeInterpreter-DS-1.3B
Opencodeinterpreter · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
LA
laya_multilingual_unsloth_dynamic
Laya · mys
Params323M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen3.8 27B NVFP4 MTP Q8attn
Qwen · utautako
Params461M
Context256K
Smallest17.4 GB
Vision
CH
chatterbox turbo
Chatterbox · cstr
Params266M
Context—
Smallest0.3 GB
GGUF
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
Vision
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool use
OL
AMD OLMo 1B SFT DPO
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Other sizes

Keep browsing