Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
LF
LMF 2.5 2B Code
Lfm · bunnycore
Params2.7B
Context128K
Smallest1.9 GB
TH
Thaki ASR KO Dialects v1 i1
Thaki · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
SM
SmolLM2 360M Instruct
SmolLM · unsloth
Params362M
Context8K
Q4_K_M0.3 GB
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
DO
DoItYourself v1 2B
Doityourself · theprint
Params1.94B
Context256K
Q4_K_M1.3 GB
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
ST
StartLux-Decision-v1.1-0.8B-Instant
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
ST
stablelm zephyr 3b
Stablelm · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
SM
SmolVLM Instruct
Smolvlm · ggml-org
Params1.81B
Context16K
Q4_K_M1.1 GB
LF
LFM2 1.2B Tool
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
OP
OpenCoder 1.5B Instruct
Opencoder · lmstudio-community
Params1.91B
Context4K
Q4_K_M1.4 GB
MO
moss tts v1.5
Moss · cstr
Params1.77B
Context—
Smallest3.5 GB
HY
HY MT1.5 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
ME
mel band roformer vocals
Mel · cstr
Params228M
Context—
Smallest0.5 GB
MO
Moonshine Streaming Tiny
Moonshine · handy-computer
Params44M
Context—
Smallest0.1 GB
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.8 27B NVFP4 MTP SSMFIX
Qwen · esatapedico
Params461M
Context256K
Smallest14.9 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
LF
LFM2.5 1.2B Instruct DSpark Draft v1
Lfm · LiquidAI
Params296M
Context125K
Q4_K_M0.2 GB
OP
OpenCodeInterpreter-DS-1.3B
Opencodeinterpreter · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
LA
laya_multilingual_unsloth_dynamic
Laya · mys
Params323M
Context—
Q4_K_M0.5 GB
QW
Qwen3.8 27B NVFP4 MTP Q8attn
Qwen · utautako
Params461M
Context256K
Smallest17.4 GB
CH
chatterbox turbo
Chatterbox · cstr
Params266M
Context—
Smallest0.3 GB
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
OL
AMD OLMo 1B SFT DPO
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB