Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
CO
C4AI inverse sft model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
MA
Magenta RealTime 2
Magenta · audio-cpp
Params2.67B
Context—
Smallest1.3 GB
QW
Qwen2 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
deepsek qwen1.5 vpn
Qwen · tsss1
Params1.78B
Context128K
Smallest1.9 GB
QW
Qwen.Qwen2.5 VL 3B Instruct
Qwen · DevQuasar-6
Params669M
Context125K
Q4_K_M1.9 GB
LL
Llm Jp 3.1 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
LL
Llama 3.2 3B Instruct Uncensored
Llama · PurpleAILAB
Params3.21B
Context128K
Q4_K_M2.0 GB
TI
TinyEnsemble-3x1.1B-TinyMoE
Tinyensemble · mradermacher
Params2.62B
Context4K
Q4_K_M1.6 GB
MI
MiniMax H3 Prompt Rewriter LoRA Omni
Minimax · pytraveler
Params323M
Context—
Smallest0.3 GB
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen3 0.6B Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params596M
Context40K
Q4_K_M0.4 GB
GI
ru girlfriend roleplay 1.5b gguf q8
Girlfriend · aiplatforms
Params1.54B
Context32K
Smallest1.6 GB
DE
DeepSeek V4.1 Flash 1017 VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
SU
supertonic 3
Supertonic · cstr
Params100M
Context—
Smallest0.2 GB
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
BA
BabyHercules 4x150M
Babyhercules · mradermacher
Params411M
Context2K
Q4_K_M0.3 GB
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
AU
Audar TTS V1 Flash
Audar · audarai
Params553M
Context32K
Q4_K_M0.5 GB
QW
Qwen3 VL 2B Thinking
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3-ASR-0.6B
Qwen · sakasegawa
Params782M
Context—
Smallest0.5 GB
HE
HelpingAI 3B hindi i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
DA
danube2-1.8b-Tess-v1.5
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
MO
MOSS Transcribe Diarize
Moss · cstr
Params909M
Context—
Smallest0.0 GB
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
Mizan v3 3B
Mizan · bartowski
Params2.9B
Context256K
Q4_K_M2.0 GB