GGUF models by tinyopsec
111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.
QW
Privasis Cleaner 4B
Qwen · tinyopsec
Params4.02B
Context40K
Q4_K_M2.5 GB
AT
Atlas Flash 1.5B Preview
Atlas · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
LF
LFM 2.5 2.6B heretic
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B abliterated
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 Coder 0.5B
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
MI
MiniCPM5 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.5 4B heretic v2
Qwen · tinyopsec
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
MiniCPM5 1B Claude Opus Fable5 V2 Thinking
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.8 4B Empero AI FullStack
Qwen · tinyopsec
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5 0.5B Instruct abliterated v3
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
MI
MiniCPM5 1B Agentic Tooluse v3 Merged FP16
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Jan v3 4B base instruct
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 0.5B abliterated
Qwen · tinyopsec
Params630M
Context32K
Q4_K_M0.5 GB
MI
MiniCPM5 1B Claude Opus Fable5 Thinking
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
LF
lfm2.5 2.6b fable5 coding agent
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
MI
mistral orpo capybara 7k
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
Orbit 3.5 Nano
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
LF
Orbit 3 Nano
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
LL
Llama 3.2 3B Instruct Medical Finetuned merged
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta Llama 3 8B Instruct Jailbroken
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
tiny random minicpm5
MiniCPM · tinyopsec
Params4M
Context128K
Q4_K_M0.0 GB
MI
MiniCPM5 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
TCAndon Router
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
rawda 4b instruct
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
svd safety l3 swift remove50 swapgapiter b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
OC
OctoThinker 8B Long Base
Octothinker · tinyopsec
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Unredacted MAX
Qwen · tinyopsec
Params4.21B
Context256K
Q4_K_M2.7 GB