GGUF models by tinyopsec

111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mistral 7b sft alpha
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
CursorCore QW2.5 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
isaacbot
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
Sailor2 1B
Qwen · tinyopsec
Params988M
Context4K
Q4_K_M0.7 GB
Tool use
QW
Qwen2.5 1.5B Spanish 1.0 DPO
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
OctoThinker 1B Short Base
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
dwight 4b
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
LL
Llama 3 6B Instruct pruned
Llama · tinyopsec
Params6.29B
Context8K
Q4_K_M3.9 GB
GGUF
MI
xor lite
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
MI
XT Luna 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
RL
rlve opd teacher R1Distill 004 Path NoGoingBack Counting 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AD
AdaptThink 7B delta0.05
Adaptthink · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Mavi 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
MI
MiniCPM5 1B Agentic Tooluse Merged FP16
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
EV
Eva 4B V2
Eva · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
MI
MiniCPM5 1B Pashto
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
RA
rank zephyr 7b v1 full
Rank · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
MiniCPM5 2B Pashto
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
LL
thagiPo-llama3.2-1B-math
Llama · tinyopsec
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
RL
rlve opd teacher R1Distill 126 MinimumUnconflictedGridKMax 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama 3 13B Instruct
Llama · tinyopsec
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
SV
Jeesup svd safety l3 swift remove20 swapgapiter b010
Svd · tinyopsec
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
yujiepan minicpm5 tiny random
MiniCPM · tinyopsec
Params4M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
SV
svd safety l3 swift jbbsft10 remove30
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
svd safety l3 basis remove40 swapgapnet rankunit b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RL
rlve opd teacher R1Distill 058 MaxDifferentGroupPairDivision 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool useVision
TI
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
group_B
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
TI
Oprius 1.1B
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing