Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mistral 7b v0.3 llama tokens
Mistral · Deeokay
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Faithful_Thinking_with_Image
Faithful · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
SW
Swallow-7b-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LI
LittleInstructionJudge 4B v0.1
Littleinstructionjudge · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
YA
models--automerger--YamshadowExperiment28-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
EV
L3-8B-Everything-COT
Everything · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · Abiray
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningVision
HA
HackerAI Pro Agent 8B
Hackerai · MrPentaxide
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Waktaverse Llama 3 KO 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MindCraft LLM tuning
Llama · Sweaterdog
Params7.6B
Context128K
Q4_K_M2.0 GB
GGUF
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
LL
llama-3-tulu-2-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
OL
Olmo 3 7B Instruct
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
OP
OpenJev Flash 9B
Openjev · openjev
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
ST
L3-8B-Stheno-v3.2-abliterated
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 9B Uncensored Cyber v3
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
AZ
Aztec Coder 4B
Aztec · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
QW
Qwen3 Stargate SG1 Uncensored Abliterated 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoning
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ZE
zen 4b i1
Zen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Other sizes

Keep browsing