Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
QW
PAW 27B X3.1
Qwen · lackonendes
Params4.86B
Context256K
Smallest0.7 GB
DA
L3 Dark Planet 8B
Dark · DavidAU
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Q4_K_M4.9 GB
GA
GameScaling 9B S1
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Fibo 2.0 GGUFs
Fibo · realrebelai
Params8.23B
Context—
Smallest6.6 GB
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · LouLou-0
Params8.95B
Context256K
Q4_K_M5.6 GB
HO
K2-Horizon-3.7B
Horizon · bartowski
Params5.06B
Context512K
Q4_K_M3.3 GB
RU
RusMind 4.6.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
hpc assistant qwen3 4b
Qwen · VaibhavKKM
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Q4_K_M5.1 GB
MO
MOSS Audio 4B Instruct
Moss · cstr
Params5.22B
Context—
Smallest0.0 GB
QW
Qwen Qwen3 VL 8B Instruct Heretic
Qwen · ThalisAI
Params8.19B
Context256K
Q4_K_M5.0 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 VL 4B Instruct Uncensored Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
AB
Hy MT2 7B Abliterated Bf16
Abliterated · alexwkleung
Params7.5B
Context256K
Q4_K_M4.6 GB
LO
LongCat Image Edit
Longcat · vantagewithai
Params6.29B
Context—
Q4_K_M3.9 GB