Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Nsfwvision_V5
Qwen · GitMylo
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
HE
L3.1 RP Hero BigTalker 8B
Hero · DavidAU
Params8B
Context128K
Q4_K_M4.9 GB
PH
Phi 3 mini 128k instruct
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
LFM2.5-8B-A1B-Uncensored-Gaston
Lfm · Justbackup
Params8.47B
Context125K
Q4_K_M5.2 GB
NA
Nanbeige4.1 3B
Nanbeige · mradermacher
Params3.93B
Context256K
Q4_K_M2.4 GB
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi 3.5 Mini ChatML
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
BA
BananaMind Translate V3.5 Pro
Bananamind · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
OR
Orpheus 3b FT Q8 0
Orpheus · lex-au
Params3.78B
Context128K
Smallest4.0 GB
OP
weyaxi_openhermes-2.5-neural-chat-v3-3-slerp
Openhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Magnum v4 9b
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3 8B Abliterated
Qwen · DuoNeural
Params8.2B
Context40K
Q4_K_M5.0 GB
NO
Nous Capybara 7B
Nous · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
CO
ContextualKunoichi KTO 7B
Contextualkunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
OC
OculusMind ToolCall 8B v2
Oculusmind · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
TY
scb10x_typhoon-7b
Typhoon · TheBloke
Params7.27B
Context32K
Q4_K_M4.4 GB
LL
Logical-elyza-llama2-7b-fast-instruct
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
VideoGuard Qwen3.5 9B Safety RL Uncensored
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
GEITje 7b Uncensored
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Huihui Qwen3 8B Abliterated v2
Qwen · dcv21
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
CH
Chocolatine 3B Instruct DPO v1.0 i1
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB