Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
CodingReasoningTool use
IM
Z Image
Image · jayn7
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
FL
Flux2 Klein 9B True V1
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
GGUF
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · OS-Software
Params7.46B
Context128K
Smallest3.7 GB
Vision
QW
Qwen3 VL 8B Thinking Unredacted MAX
Qwen · prithivMLmods
Params8.19B
Context256K
Smallest8.7 GB
ReasoningVision
QW
Qwen3.8 4b Heretic Trial23
Qwen · hakergeniusz
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
TO
tokyotech llm Swallow 7b NVE instruct hf
Tokyotech · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · lmstudio-community
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
LL
Llama 2 7b chat hf function calling v2
Llama · Trelis
Params7B
Context—
Smallest0.0 GB
GGUF
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
GE
Gemma 4 E2B Conversational Uncensored
Gemma · minas2025
Params4.65B
Context128K
Smallest5.0 GB
Vision
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Q4_K_M4.9 GB
Vision
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
GGUF
SP
Spark X2.6 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
AI
aidc-ai-business_marcoroni-7b-v3
Aidc · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
GGUF
QW
Qwen2-7B
Qwen · legraphista
Params7.62B
Context128K
Smallest1.9 GB
GGUF
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
MI
models--automerger--Experiment28T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
emrgnt-cmplxty_mistral-7b-phibrarian-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF

Other sizes

Keep browsing