Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
IN
Index Nailong 2B
Index · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3-ForcedAligner-0.6B
Qwen · OpenVoiceOS
Params918M
Context—
Q4_K_M0.6 GB
GE
Winnow E2B
Gemma · EldanRing
Params77M
Context128K
Smallest0.2 GB
KI
Kimodo-G1-RP-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
ELISARCyberAIEdge7B LoRA
Mistral · sallani
Params42M
Context—
Smallest0.2 GB
LF
LFM2.5 2.6B Uncensored Trial65
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
WA
wav2vec2 large xlsr 53 english
Wav · cstr
Params315M
Context—
Smallest0.2 GB
LF
LFM3-Omni-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
PY
Pythia 160m Deduped
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
IN
InternLM2
InternLM · legraphista
Params1.89B
Context8K
Smallest0.5 GB
MI
MiniCPM5 2B DSpark
MiniCPM · magnitudedev
Params324M
Context128K
Smallest0.7 GB
LF
LFM3-VL-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
GL
GLM-ASR-Nano-2512
GLM · Mungert
Params1.59B
Context8K
Q4_K_M1.1 GB
LF
LFM2 1.2B Extract
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Ministral 3 3B Qwen3.8 Max Reasoning Distilled
Qwen · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
alist food text qwen35
Qwen · NateRunsA-LIST
Params44M
Context256K
Q4_K_M1.3 GB