Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MO
models moved
Models · hfmaster
Params8.03B
Context256K
Q4_K_M5.0 GB
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hana 0.1 Fast
Qwen · dwmk
Params8.03B
Context32K
Smallest0.3 GB
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
NU
NuExtract v1.5
Nuextract · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen3.5 9B Holodeck Lounge
Qwen · nightmedia
Params8.95B
Context256K
Q4_K_M5.6 GB
IN
Index Nailong 9B
Index · IndexTeam
Params8.95B
Context224K
Q4_K_M5.6 GB
MI
fpham_autolycus-mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
Flux 3 Image Klein Prompt Upsampler Abliterated
Flux · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3-4B-Nymphaea-RP
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
VI
bofenghuang_vigogne-2-7b-instruct
Vigogne · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
IN
InverseCoder-DS-6.7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MA
MagpieLM 8B Chat v0.1 i1
Magpielm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CH
Chocolatine 3B Instruct DPO Revised Q4 K M
Chocolatine · jpacifico
Params3.82B
Context4K
Q4_K_M2.4 GB
SW
Swallow MS 7b Instruct v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
WI
winter garden 7b alpha
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama-3-8B-Instruct-MopeyMule
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
BI
Bielik 7B Instruct v0.1
Bielik · speakleash
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Qwen3 VL 4B Instruct Abliterated v1
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
MI
leolm_leo-mistral-hessianai-7b-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
Breeze 7B 32k Instruct V1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
mistral 7b orpo capybara reproduction
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AI
airoboros l2 7B gpt4 2.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3-Vl-8B-Instruct-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
EL
Elephant 1
Elephant · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
RenCoder Ministral 8B Instruct 2410
Mistral · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB