Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Q4_K_M5.6 GB
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
IM
Z Image
Image · jayn7
Params6.15B
Context—
Q4_K_M5.0 GB
FL
Flux2 Klein 9B True V1
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · OS-Software
Params7.46B
Context128K
Smallest3.7 GB
QW
Qwen3 VL 8B Thinking Unredacted MAX
Qwen · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
QW
Qwen3.8 4b Heretic Trial23
Qwen · hakergeniusz
Params4.21B
Context256K
Q4_K_M2.7 GB
TO
tokyotech llm Swallow 7b NVE instruct hf
Tokyotech · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · lmstudio-community
Params7.8B
Context32K
Q4_K_M4.8 GB
LL
Llama 2 7b chat hf function calling v2
Llama · Trelis
Params7B
Context—
Smallest0.0 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
GE
Gemma 4 E2B Conversational Uncensored
Gemma · minas2025
Params4.65B
Context128K
Smallest5.0 GB
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Q4_K_M4.9 GB
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
SP
Spark X2.6 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
AI
aidc-ai-business_marcoroni-7b-v3
Aidc · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
QW
Qwen2-7B
Qwen · legraphista
Params7.62B
Context128K
Smallest1.9 GB
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
models--automerger--Experiment28T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
emrgnt-cmplxty_mistral-7b-phibrarian-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB