Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen AgentWorld 35B A3B MTP Uncensored APEX
Qwen · SC117
Params447M
Context—
Smallest0.2 GB
GGUF
MI
MiniCPM5 2B Abliterated Uncensored
MiniCPM · mondk
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
QW
Qwen3.8 2B Uncensored
Qwen · atakhadivi
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED NVFP4 DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
Vision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
ST
stable diffusion xl base 1.0
Stable · gpustack
Params3.47B
Context—
Smallest3.9 GB
GGUF
MI
MiniCPM OCR Jev
MiniCPM · openbmb
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
LI
vllm-d3-lite
Lite · ggml-org
Params1.01B
Context256K
Smallest1.1 GB
Vision
TE
test gguf moe sample
Test · SzymonOzog
Params403M
Context—
Smallest0.1 GB
GGUF
GR
Granite 4.0 Micro
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
JI
jinen-v1-xsmall-hf
Jinen · togatogah
Params36M
Context1K
Smallest0.0 GB
GGUF
CO
Confucius4 R2T2
Confucius · netease-youdao
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
TE
Ternary Bonsai 1.7B
Ternary · prism-ml
Params1.72B
Context32K
Smallest0.5 GB
GGUF
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
GGUF
ST
stablelm 2 zephyr 1 6b
Stablelm · stabilityai
Params1.64B
Context4K
Smallest1.0 GB
GGUF
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · NousResearch
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
DE
DeepSeek OCR
DeepSeek · ggml-org
Params2.93B
Context—
Smallest3.1 GB
GGUF
LF
LFM2.5 VL 3B Uncensored
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
QW
Qwopus3.6 27B v2
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen3.8-27B-DFlash2-ternary-bonsai2-r3
Qwen · naklitechie
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 0.8B GGUF uncensored opus distill
Qwen · amkkk
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
DA
DanTagGen alpha
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
GGUF
NA
VisionPsy Nano 460M Flash GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
Vision
DA
DanTagGen delta
Dantaggen · KBlueLeaf
Params393M
Context2K
Smallest0.3 GB
GGUF
MI
MiniCPM V Apps
MiniCPM · tc-mb
Params912M
Context256K
Q4_K_M0.5 GB
Vision
GR
Granite Vision 4.1 4b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
Vision
MO
Moss image nsfw uncensored lora
Moss · axiomofmind
Params37M
Context—
Smallest0.1 GB
GGUF

Other sizes

Keep browsing