Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4AI inverse sft model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
MA
Magenta RealTime 2
Magenta · audio-cpp
Params2.67B
Context—
Smallest1.3 GB
GGUF
QW
Qwen2 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
QW
deepsek qwen1.5 vpn
Qwen · tsss1
Params1.78B
Context128K
Smallest1.9 GB
GGUF
QW
Qwen.Qwen2.5 VL 3B Instruct
Qwen · DevQuasar-6
Params669M
Context125K
Q4_K_M1.9 GB
Vision
LL
Llm Jp 3.1 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
LL
Llama 3.2 3B Instruct Uncensored
Llama · PurpleAILAB
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
TI
TinyEnsemble-3x1.1B-TinyMoE
Tinyensemble · mradermacher
Params2.62B
Context4K
Q4_K_M1.6 GB
Tool use
MI
MiniMax H3 Prompt Rewriter LoRA Omni
Minimax · pytraveler
Params323M
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
Qwen3 0.6B Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GI
ru girlfriend roleplay 1.5b gguf q8
Girlfriend · aiplatforms
Params1.54B
Context32K
Smallest1.6 GB
RoleplayTool use
DE
DeepSeek V4.1 Flash 1017 VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
SU
supertonic 3
Supertonic · cstr
Params100M
Context—
Smallest0.2 GB
GGUF
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
BA
BabyHercules 4x150M
Babyhercules · mradermacher
Params411M
Context2K
Q4_K_M0.3 GB
GGUF
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
AU
Audar TTS V1 Flash
Audar · audarai
Params553M
Context32K
Q4_K_M0.5 GB
GGUF
QW
Qwen3 VL 2B Thinking
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3-ASR-0.6B
Qwen · sakasegawa
Params782M
Context—
Smallest0.5 GB
GGUF
HE
HelpingAI 3B hindi i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
DA
danube2-1.8b-Tess-v1.5
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
MO
MOSS Transcribe Diarize
Moss · cstr
Params909M
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mizan v3 3B
Mizan · bartowski
Params2.9B
Context256K
Q4_K_M2.0 GB
Vision

Other sizes

Keep browsing