Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen AgentWorld 35B A3B MTP Uncensored APEX
Qwen · SC117
Params447M
Context—
Smallest0.2 GB
MI
MiniCPM5 2B Abliterated Uncensored
MiniCPM · mondk
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen3.8 2B Uncensored
Qwen · atakhadivi
Params1.88B
Context256K
Q4_K_M1.3 GB
GL
GLM 5.3 Flash UNCENSORED NVFP4 DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
stable diffusion xl base 1.0
Stable · gpustack
Params3.47B
Context—
Smallest3.9 GB
MI
MiniCPM OCR Jev
MiniCPM · openbmb
Params1.88B
Context256K
Q4_K_M1.3 GB
LI
vllm-d3-lite
Lite · ggml-org
Params1.01B
Context256K
Smallest1.1 GB
TE
test gguf moe sample
Test · SzymonOzog
Params403M
Context—
Smallest0.1 GB
GR
Granite 4.0 Micro
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
JI
jinen-v1-xsmall-hf
Jinen · togatogah
Params36M
Context1K
Smallest0.0 GB
CO
Confucius4 R2T2
Confucius · netease-youdao
Params1.72B
Context64K
Q4_K_M1.1 GB
TE
Ternary Bonsai 1.7B
Ternary · prism-ml
Params1.72B
Context32K
Smallest0.5 GB
LT
LTX Video
Ltx · city96
Params1.92B
Context—
Q4_K_M1.4 GB
ST
stablelm 2 zephyr 1 6b
Stablelm · stabilityai
Params1.64B
Context4K
Smallest1.0 GB
FA
fastvlm
Fastvlm · gguf-org
Params759M
Context—
Q4_K_M1.4 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · NousResearch
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
DeepSeek OCR
DeepSeek · ggml-org
Params2.93B
Context—
Smallest3.1 GB
LF
LFM2.5 VL 3B Uncensored
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwopus3.6 27B v2
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8-27B-DFlash2-ternary-bonsai2-r3
Qwen · naklitechie
Params1.92B
Context256K
Q4_K_M1.1 GB
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
QW
Qwen3.5 0.8B GGUF uncensored opus distill
Qwen · amkkk
Params752M
Context256K
Q4_K_M0.5 GB
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
DA
DanTagGen alpha
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
NA
VisionPsy Nano 460M Flash GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
DA
DanTagGen delta
Dantaggen · KBlueLeaf
Params393M
Context2K
Smallest0.3 GB
MI
MiniCPM V Apps
MiniCPM · tc-mb
Params912M
Context256K
Q4_K_M0.5 GB
GR
Granite Vision 4.1 4b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
MO
Moss image nsfw uncensored lora
Moss · axiomofmind
Params37M
Context—
Smallest0.1 GB