Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
nemotron 3.5 asr streaming
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
GGUF
IR
iris 3b GGUFs
Iris · realrebelai
Params3B
Context—
Smallest1.3 GB
GGUF
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 3B Instruct
Qwen · RagnarokChan
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
SA
Sakura d1 3B HighQuality
webmp3
Params2.7B
Context—
Smallest0.0 GB
GGUF
VI
VieNeu TTS 0.3B
Vieneu · pnnbao-ump
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GE
Gemma 3 1b It
Gemma · second-state
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingTool use
LL
nanoLLaVA
LLaVA · abetlen
Params620M
Context32K
Smallest1.2 GB
Vision
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
QW
SpaceThinker Qwen2.5VL 3B
Qwen · remyxai
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
WA
wav2vec2 large xlsr 53 japanese
Wav · cstr
Params318M
Context—
Smallest0.2 GB
GGUF
LF
Koda IDS Frontier F16
Lfm · netgoat-ai
Params2.7B
Context128K
Q4_K_M1.7 GB
Reasoning
TR
TranscribePsy 250M EU sub
Transcribepsy · qvac
Params283M
Context—
Smallest0.3 GB
GGUF
LL
Llama Guard 3 1B
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
CH
ChatGPT-2.V2
Chatgpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
QW
Qwen3.8 9B Distill uncensored heretic
Qwen · nuofang
Params1M
Context—
Smallest0.0 GB
GGUF
SD
SDXL Lightning
Sdxl · OlegSkutte
Params3.47B
Context—
Smallest4.1 GB
GGUF
VI
VibeVoice-1.5B
Vibevoice · cstr
Params2.7B
Context—
Smallest1.9 GB
GGUF
MI
minecraft
Minecraft · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 Sex
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FN
FNova 1.7B Chat v1
Fnova · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
LF
LFM2.5 1.2B Base
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
BL
bling stable lm 3b 4e1t v0
Bling · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
QW
Josiefied Qwen2.5 1.5B Instruct abliterated v3
Qwen · Goekdeniz-Guelmez
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Other sizes

Keep browsing