Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
LL
Cogito v1 Preview Llama 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
NU
NuExtract v1.5
Nuextract · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
LL
Llama-3-Mopeyfied-Psychology-v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · mradermacher
Params8B
Context1024K
Q4_K_M4.9 GB
MI
Mixtral AI CyberUltron DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
GroundGUI 8B
Groundgui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistral Scary Story Finetune
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
jphme_em_german_mistral_v01
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Bella Tao Merged Qwen2_5 Coder 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AL
models--automerger--AlloyingotneoyExperiment24-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
openchat 3.5 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Taigi Llama 2 Translator 7B
Llama · RichardErkhov
Params6.94B
Context4K
Q4_K_M4.2 GB
KU
KukulStanta InfinityRP 7B slerp i1
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PR
prometheus 7B v1.0
Prometheus · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 mini 4k geminified
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
NE
NeoCortex 7B slerp
Neocortex · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GR
Grug 9b
Grug · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
CL
Claire 7B 0.1
Claire · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
WI
WizardMath 7B V1.1 i1
Wizardmath · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · Andycurrent
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 VL 8B Instruct
Qwen · wareef
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.5 9B
Qwen · prithivMLmods
Params9.2B
Context256K
Q4_K_M5.8 GB
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 German 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB