Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
AR
ARK 270M Base i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
GGUF
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
Vision
MI
mistralai_Ministral 3 3B Reasoning 2512
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
KH
kheops compressed
Kheops · mradermacher
Params283M
Context2K
Q4_K_M0.2 GB
GGUF
SH
Shellwhisperer 1.5b
Shellwhisperer · fableforge-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama 3.2 Chibi 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MI
MinerU2.5 Pro 2604 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
Vision
QW
qwen3 1.7b gsm8k sft
Qwen · HuggingFaceTB
Params1.72B
Context40K
Smallest1.8 GB
Reasoning
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
OP
OpenELM-450M-Instruct
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 1b
Llama · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
CodingTool use
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ST
stablelm-zephyr-3b
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MO
Motif Video 2B
Motif · Motif-Technologies
Params2.04B
Context—
Q4_K_M1.2 GB
GGUF
MO
moss transcribe.cpp
Moss · mudler
Params909M
Context—
Smallest0.5 GB
GGUF
LU
Luminus 1.5B Roleplay
Luminus · ReXeeD
Params1.54B
Context32K
Q4_K_M1.0 GB
Roleplay
BE
Bernini 1.3B ComfyUI
Bernini · neuregex
Params1.42B
Context—
Q4_K_M1.0 GB
GGUF
GE
Gemma 4 E4B It Assistant
Gemma · AtomicChat
Params78M
Context128K
Q4_K_M0.1 GB
GGUF
PA
PaddleOCR VL 1.6
Paddleocr · SanjeevSOLANKI
Params467M
Context128K
Q4_K_M0.3 GB
Vision
DA
data2vec audio 960h
Data · cstr
Params94M
Context—
Smallest0.1 GB
GGUF
LL
Llama 3.2 1B Instruct Abliterated
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
CO
cosmo-1b
Cosmo · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
GE
GemmaDGAF 2B
Gemma · hecan3d
Params2.6B
Context8K
Q4_K_M1.7 GB
Roleplay
AR
arco interpreter v1.2
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
GE
gemma 2 2b it Flight Multi Turn V3 DPO
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CH
Chatterbox TTS Persian
Chatterbox · mazrba
Params264M
Context—
Smallest0.4 GB
GGUF
LF
LiquidAI.LFM2 2.6B Transcript
Lfm · DevQuasar
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · bartowski
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF

Other sizes

Keep browsing