Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
NE
nemotron 3.5 asr streaming
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
IR
iris 3b GGUFs
Iris · realrebelai
Params3B
Context—
Smallest1.3 GB
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Qwen2.5 3B Instruct
Qwen · RagnarokChan
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
SA
Sakura d1 3B HighQuality
webmp3
Params2.7B
Context—
Smallest0.0 GB
VI
VieNeu TTS 0.3B
Vieneu · pnnbao-ump
Params244M
Context4K
Q4_K_M0.2 GB
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Gemma 3 1b It
Gemma · second-state
Params1B
Context32K
Q4_K_M0.8 GB
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
LL
nanoLLaVA
LLaVA · abetlen
Params620M
Context32K
Smallest1.2 GB
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
SpaceThinker Qwen2.5VL 3B
Qwen · remyxai
Params3.09B
Context125K
Q4_K_M1.9 GB
WA
wav2vec2 large xlsr 53 japanese
Wav · cstr
Params318M
Context—
Smallest0.2 GB
LF
Koda IDS Frontier F16
Lfm · netgoat-ai
Params2.7B
Context128K
Q4_K_M1.7 GB
TR
TranscribePsy 250M EU sub
Transcribepsy · qvac
Params283M
Context—
Smallest0.3 GB
LL
Llama Guard 3 1B
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
CH
ChatGPT-2.V2
Chatgpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
QW
Qwen3.8 9B Distill uncensored heretic
Qwen · nuofang
Params1M
Context—
Smallest0.0 GB
SD
SDXL Lightning
Sdxl · OlegSkutte
Params3.47B
Context—
Smallest4.1 GB
VI
VibeVoice-1.5B
Vibevoice · cstr
Params2.7B
Context—
Smallest1.9 GB
MI
minecraft
Minecraft · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 Sex
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
FN
FNova 1.7B Chat v1
Fnova · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
LF
LFM2.5 1.2B Base
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
BL
bling stable lm 3b 4e1t v0
Bling · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Josiefied Qwen2.5 1.5B Instruct abliterated v3
Qwen · Goekdeniz-Guelmez
Params1.54B
Context32K
Q4_K_M1.0 GB