GGUF models by tinyopsec

111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Privasis Cleaner 4B
Qwen · tinyopsec
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
AT
Atlas Flash 1.5B Preview
Atlas · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LF
LFM 2.5 2.6B heretic
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B abliterated
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen2.5 Coder 0.5B
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
MI
MiniCPM5 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Qwen3.5 4B heretic v2
Qwen · tinyopsec
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
MI
MiniCPM5 1B Claude Opus Fable5 V2 Thinking
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Qwen3.8 4B Empero AI FullStack
Qwen · tinyopsec
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
QW
Qwen2.5 0.5B Instruct abliterated v3
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
MI
MiniCPM5 1B Agentic Tooluse v3 Merged FP16
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Jan v3 4B base instruct
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingTool use
QW
Qwen2.5 0.5B abliterated
Qwen · tinyopsec
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
MI
MiniCPM5 1B Claude Opus Fable5 Thinking
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LF
lfm2.5 2.6b fable5 coding agent
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
MI
mistral orpo capybara 7k
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LF
Orbit 3.5 Nano
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
LF
Orbit 3 Nano
Lfm · tinyopsec
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
LL
Llama 3.2 3B Instruct Medical Finetuned merged
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Meta Llama 3 8B Instruct Jailbroken
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
tiny random minicpm5
MiniCPM · tinyopsec
Params4M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
MI
MiniCPM5 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
TCAndon Router
Qwen · tinyopsec
Params4.41B
Context256K
Q4_K_M2.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
rawda 4b instruct
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
LL
svd safety l3 swift remove50 swapgapiter b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OC
OctoThinker 8B Long Base
Octothinker · tinyopsec
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Qwen3.5 4B Unredacted MAX
Qwen · tinyopsec
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

Keep browsing