Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
EA
EAN 8B i1
Ean · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LF
Atomic Chat / LFM2.5 8B A1B
Lfm · AlexAtomic
Params8.47B
Context125K
Q4_K_M5.2 GB
GE
DiarizationLM Gemma 4 E4B v1
Gemma · diarizers-community
Params7.46B
Context128K
Q4_K_M5.3 GB
SW
Swallow-7b-NVE-instruct-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
Huihui Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
YI
01 ai Yi 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
KR
Kronumos Kairos v2
Kronumos · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
ME
Meltemi 7B Instruct v1
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
CL
clef flash
Clef · NANI-Nithin
Params8.95B
Context256K
Q4_K_M5.6 GB
MO
Morpho 7B Distill
Morpho · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
FI
v6 Finch 7B HF
Finch · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · SanctumAI
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
YI
CursorCore Yi 9B i1
Yi · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
OL
OLMo 7B 0424 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
OR
Ornith 1.5 9B Uncensored
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mahou-1.3c-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemotron Cascade 8B Thinking
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
BO
prism ml Bonsai 8B unpacked
Bonsai · bartowski
Params8.19B
Context64K
Q4_K_M5.2 GB
DI
Dirty Muse Writer v01 Uncensored Erotica NSFW
Dirty · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 2 Coder 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Reflection Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 8B Uncensor v2
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LY
LYNX ALPHA
Lynx · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
VN
Vnpen Writer 9b v1.0
Vnpen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB