GGUF models by tinyopsec
111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.
QW
lalo 1.5b
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
incorrecter
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
SK
Skywork OR1 7B
Skywork · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
llama 3 chinese 8b instruct v3
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.2 3b Heretic
Granite · tinyopsec
Params3.66B
Context128K
Q4_K_M2.2 GB
QW
L1 Qwen3 8B Exact
Qwen · tinyopsec
Params8.19B
Context40K
Q4_K_M5.0 GB
SV
Jeesup svd safety l3 swift remove40 swapgapiter evfront b010
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct Neurona 8b
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 Korean GGACHI 1B Instruct v1
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
LF
Pallete 2.6B RP Reasoning 2609 v1a
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
UniSS
Qwen · tinyopsec
Params1.86B
Context32K
Q4_K_M1.2 GB
MI
MiniCPM5 2B SFT Pashto
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
LL
Llama 3.2 1b Instruct Fine Tuned
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
chinese text correction 1.5b
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
RO
RoLlama3 8b Instruct
Rollama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 3B Instruct Sheldon SFT v2 merged
Qwen · tinyopsec
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
LaleYard 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
SV
svd safety l3 swift remove50 swapgapiter evfront b010
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NPO SAM WMDP llama3 8b instruct
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
StepFun Formalizer 7B
Stepfun · tinyopsec
Params7.62B
Context128K
Smallest15.2 GB
SV
Jeesup svd safety l3 swift jbbsft10 remove30
Svd · tinyopsec
Params8.03B
Context8K
Smallest16.1 GB
QW
DeepReasoning 1R
Qwen · tinyopsec
Params494M
Context32K
Smallest1.0 GB
QW
limbic tool use 0.5B 32K
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
QW
NuExtract 1.5 tiny
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
QW
StepGuard
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Instruct 2507 heretic
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
SRA RiskGate 4B
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwimi 4B
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Instruct 2507 abliterated
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB