Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
RE
RedSage K SFT GRPO
Redsage · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored V2 OBLITERATED
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CL
Clef Flash
Clef · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
ST
Step3 VL 10B Base
Step · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
MA
MAmmoTH 7B
Mammoth · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
Lh41 1042 Magellanic 7B 0711
Magellanic · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
LO
lobe3 i1
Lobe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
HU
Hunyuan 7B Instruct
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
QwenPaw Flash 9B heretic
Qwen · SC117
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
QW
Qwen3.5 9B RpRMax v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HU
Huihui HY MT1.5 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
HuatuoGPT 3 8B
Huatuogpt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
TO
models--Iker--TowerInstruct-7B-v0.2-EN2ES
Towerinstruct · MaziyarPanahi
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 8B 64k Josiefied Uncensored NEO Max
Qwen · DavidAU
Params8.19B
Context64K
Q4_K_M5.8 GB
ReasoningRoleplay
DI
dictalm2.0-instruct
Dictalm · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
CodingReasoning
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 E4B Q4 K M
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
UG
L3-8B-UGI-DontPlanToEnd-test
Ugi · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL PaperWitch Heresy
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningRoleplay
GE
Gemma 4 E4B Abliterated
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
Coding
MO
MotherEarth_1.0
Motherearth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Fireball Llama 3.1 8B Philos Reflection v0.3 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
KO
Koa AI v2 Code 9B
Koa · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingVision
CA
Calme-7B-Instruct-v0.1.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
JA
Jais ASR
Jais · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
CodingVision
QW
SuperCorrect 7B
Qwen · QuantFactory
Params7.6B
Context4K
Q4_K_M4.7 GB
GGUF
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other sizes

Keep browsing