Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
GGUF
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
IN
Index Nailong 2B
Index · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
QW
Qwen3-ForcedAligner-0.6B
Qwen · OpenVoiceOS
Params918M
Context—
Q4_K_M0.6 GB
GGUF
GE
Winnow E2B
Gemma · EldanRing
Params77M
Context128K
Smallest0.2 GB
Vision
KI
Kimodo-G1-RP-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GGUF
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MI
ELISARCyberAIEdge7B LoRA
Mistral · sallani
Params42M
Context—
Smallest0.2 GB
GGUF
LF
LFM2.5 2.6B Uncensored Trial65
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
WA
wav2vec2 large xlsr 53 english
Wav · cstr
Params315M
Context—
Smallest0.2 GB
GGUF
LF
LFM3-Omni-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
PY
Pythia 160m Deduped
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params1.89B
Context8K
Smallest0.5 GB
GGUF
MI
MiniCPM5 2B DSpark
MiniCPM · magnitudedev
Params324M
Context128K
Smallest0.7 GB
GGUF
LF
LFM3-VL-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
GL
GLM-ASR-Nano-2512
GLM · Mungert
Params1.59B
Context8K
Q4_K_M1.1 GB
GGUF
LF
LFM2 1.2B Extract
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Ministral 3 3B Qwen3.8 Max Reasoning Distilled
Qwen · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool use
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
Vision
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingTool useVision
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
alist food text qwen35
Qwen · NateRunsA-LIST
Params44M
Context256K
Q4_K_M1.3 GB
Vision

Other sizes

Keep browsing