GGUF models by tinyopsec

111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
lalo 1.5b
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
incorrecter
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SK
Skywork OR1 7B
Skywork · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
LL
llama 3 chinese 8b instruct v3
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.2 3b Heretic
Granite · tinyopsec
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
QW
L1 Qwen3 8B Exact
Qwen · tinyopsec
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
SV
Jeesup svd safety l3 swift remove40 swapgapiter evfront b010
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Instruct Neurona 8b
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 Korean GGACHI 1B Instruct v1
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LF
Pallete 2.6B RP Reasoning 2609 v1a
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningRoleplayTool use
QW
UniSS
Qwen · tinyopsec
Params1.86B
Context32K
Q4_K_M1.2 GB
Tool use
MI
MiniCPM5 2B SFT Pashto
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
LL
Llama 3.2 1b Instruct Fine Tuned
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
chinese text correction 1.5b
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
RO
RoLlama3 8b Instruct
Rollama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 3B Instruct Sheldon SFT v2 merged
Qwen · tinyopsec
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
LaleYard 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
SV
svd safety l3 swift remove50 swapgapiter evfront b010
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NPO SAM WMDP llama3 8b instruct
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
StepFun Formalizer 7B
Stepfun · tinyopsec
Params7.62B
Context128K
Smallest15.2 GB
Tool use
SV
Jeesup svd safety l3 swift jbbsft10 remove30
Svd · tinyopsec
Params8.03B
Context8K
Smallest16.1 GB
GGUF
QW
DeepReasoning 1R
Qwen · tinyopsec
Params494M
Context32K
Smallest1.0 GB
ReasoningTool use
QW
limbic tool use 0.5B 32K
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
NuExtract 1.5 tiny
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
StepGuard
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwen3 4B Instruct 2507 heretic
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
SRA RiskGate 4B
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwimi 4B
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3 4B Instruct 2507 abliterated
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use

Keep browsing