Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
AR
ARK 270M Base i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
MI
mistralai_Ministral 3 3B Reasoning 2512
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
KH
kheops compressed
Kheops · mradermacher
Params283M
Context2K
Q4_K_M0.2 GB
SH
Shellwhisperer 1.5b
Shellwhisperer · fableforge-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
MinerU2.5 Pro 2604 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
QW
qwen3 1.7b gsm8k sft
Qwen · HuggingFaceTB
Params1.72B
Context40K
Smallest1.8 GB
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
OP
OpenELM-450M-Instruct
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
LL
Dolphin 3.0 Llama 3.2 1b
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ST
stablelm-zephyr-3b
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
MO
Motif Video 2B
Motif · Motif-Technologies
Params2.04B
Context—
Q4_K_M1.2 GB
MO
moss transcribe.cpp
Moss · mudler
Params909M
Context—
Smallest0.5 GB
LU
Luminus 1.5B Roleplay
Luminus · ReXeeD
Params1.54B
Context32K
Q4_K_M1.0 GB
BE
Bernini 1.3B ComfyUI
Bernini · neuregex
Params1.42B
Context—
Q4_K_M1.0 GB
GE
Gemma 4 E4B It Assistant
Gemma · AtomicChat
Params78M
Context128K
Q4_K_M0.1 GB
PA
PaddleOCR VL 1.6
Paddleocr · SanjeevSOLANKI
Params467M
Context128K
Q4_K_M0.3 GB
DA
data2vec audio 960h
Data · cstr
Params94M
Context—
Smallest0.1 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
CO
cosmo-1b
Cosmo · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GE
GemmaDGAF 2B
Gemma · hecan3d
Params2.6B
Context8K
Q4_K_M1.7 GB
AR
arco interpreter v1.2
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GE
gemma 2 2b it Flight Multi Turn V3 DPO
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
Chatterbox TTS Persian
Chatterbox · mazrba
Params264M
Context—
Smallest0.4 GB
LF
LiquidAI.LFM2 2.6B Transcript
Lfm · DevQuasar
Params2.57B
Context125K
Q4_K_M1.6 GB
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB