Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
OL
OLMoE 1B 7B 0924 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
QW
PAW 27B X3.1
Qwen · lackonendes
Params4.86B
Context256K
Smallest0.7 GB
GGUF
DA
L3 Dark Planet 8B
Dark · DavidAU
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Q4_K_M5.0 GB
Reasoning
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
Coding
GA
GameScaling 9B S1
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
FI
Fibo 2.0 GGUFs
Fibo · realrebelai
Params8.23B
Context—
Smallest6.6 GB
GGUF
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
Vision
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · LouLou-0
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
HO
K2-Horizon-3.7B
Horizon · bartowski
Params5.06B
Context512K
Q4_K_M3.3 GB
GGUF
RU
RusMind 4.6.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
QW
hpc assistant qwen3 4b
Qwen · VaibhavKKM
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Q4_K_M5.1 GB
GGUF
MO
MOSS Audio 4B Instruct
Moss · cstr
Params5.22B
Context—
Smallest0.0 GB
GGUF
QW
Qwen Qwen3 VL 8B Instruct Heretic
Qwen · ThalisAI
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
ReasoningTool useVision
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3 VL 4B Instruct Uncensored Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Roleplay
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
AB
Hy MT2 7B Abliterated Bf16
Abliterated · alexwkleung
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
LO
LongCat Image Edit
Longcat · vantagewithai
Params6.29B
Context—
Q4_K_M3.9 GB
GGUF

Other sizes

Keep browsing