Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · kepom
Params7.6B
Context32K
Q4_K_M4.7 GB
PH
phi3.5 gutenberg 4B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
SA
vagosolutions_sauerkrautlm-7b-hero
Sauerkrautlm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma 4 hacking
Gemma · deathafteryou
Params7.5B
Context128K
Q4_K_M5.3 GB
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
TM
Tmax v1.1 9b
Tmax · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ST
stablelm tuned alpha 7b i1
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
OR
Ornith-1.5-9B-Uncensored
Ornith · vonvonhero
Params8.95B
Context256K
Q4_K_M5.6 GB
FR
FrogNano 4B 2609
Frognano · webmp3
Params4.33B
Context256K
Smallest2.0 GB
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
JA
Jan-v3-4b-base-instruct
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
DP
openaccess-ai-collective_dpopenhermes-7b-v2
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · zugquants
Params8.95B
Context256K
Q4_K_M6.8 GB
AI
jondurbin_airoboros-m-7b-3.1.2
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Med Advisor Conversation 4B
Med · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
JA
Jais adapted 7B Reflection Tuning Natural Farmer i1
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
GE
Security SLM Gemma 4 E2B it
Gemma · entrick
Params4.65B
Context128K
Q4_K_M3.4 GB
MI
Ministral 3 8B Nymphaea RP
Mistral · 0xA50C1A1
Params8.49B
Context—
Smallest0.0 GB
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GE
Gemma 3 4b It Heretic Uncensored Abliterated Extreme
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 8B Heretic GGUF
Qwen · xFanexx
Params8.19B
Context40K
Q4_K_M5.0 GB