Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
MO
MOSS Image Text Encoder Heretic
Moss · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Emma 500 Llama2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
KA
Kairos
Kairos · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
CO
COBOL Coder 7B Instruct i1
Cobol · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LO
louisbrulenaudet Maxine 7B 0401 stock
Louisbrulenaudet · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--Shadowm7expMergerix-7B
Shadowm · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
HA
Hathor Sofit L3 8B v1
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
BO
Borealis Open 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QU
R3GE Quen2.5 7B
Quen · dothisright
Params7.62B
Context128K
Q4_K_M4.7 GB
WA
wan22 qx encoders
Wan · wangkanai
Params5.68B
Context512
Smallest2.9 GB
LL
llama3 8b chat uncensored
Llama · georgesung
Params8B
Context8K
Smallest4.7 GB
QW
Qwen3.5 9B Claude 4.6 OS HERETIC UNCENSORED INSTRUCT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RO
RoMistral-7b-Instruct
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 7B Instruct Q4 K M
Qwen · Ygz-08123
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 2 9b It
Gemma · DiTy
Params9.24B
Context8K
Smallest18.5 GB
HA
potatooff_hamster-0.1
Hamster · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DR
DreadPoor Harpy 7B Model Stock
Dreadpoor · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
sanjiwatsuki_lelantos-maid-dpo-7b
Lelantos · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
TO
llm-agents_tora-code-7b-v1.0
Tora · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · DevQuasar-7
Params8B
Context128K
Q4_K_M4.9 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
MI
MiMo Ornith 9B AGSI Abliterated HQ
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mistraldouble 7B task
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
bielik 4.5b v3 matura history sft2
Bielik · SlayerLab
Params4.76B
Context—
Smallest0.0 GB