GGUF models by tinyopsec
111 GGUF models quantized by tinyopsec on Hugging Face. Sizes run from 4M to 13B parameters. The longest trained context is 256K tokens.
MI
mistral 7b sft alpha
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
CursorCore QW2.5 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
isaacbot
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Sailor2 1B
Qwen · tinyopsec
Params988M
Context4K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B Spanish 1.0 DPO
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
OctoThinker 1B Short Base
Llama · tinyopsec
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
dwight 4b
Qwen · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
Llama 3 6B Instruct pruned
Llama · tinyopsec
Params6.29B
Context8K
Q4_K_M3.9 GB
MI
xor lite
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
MI
XT Luna 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
RL
rlve opd teacher R1Distill 004 Path NoGoingBack Counting 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
AD
AdaptThink 7B delta0.05
Adaptthink · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Mavi 1.5B
Qwen · tinyopsec
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
MiniCPM5 1B Agentic Tooluse Merged FP16
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
EV
Eva 4B V2
Eva · tinyopsec
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
MiniCPM5 1B Pashto
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
RA
rank zephyr 7b v1 full
Rank · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM5 2B Pashto
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
LL
thagiPo-llama3.2-1B-math
Llama · tinyopsec
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
Qwen2.5 0.5B
Qwen · tinyopsec
Params494M
Context32K
Q4_K_M0.4 GB
RL
rlve opd teacher R1Distill 126 MinimumUnconflictedGridKMax 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 3 13B Instruct
Llama · tinyopsec
Params13B
Context8K
Q4_K_M7.9 GB
SV
Jeesup svd safety l3 swift remove20 swapgapiter b010
Svd · tinyopsec
Params8.03B
Context8K
Smallest3.2 GB
MI
yujiepan minicpm5 tiny random
MiniCPM · tinyopsec
Params4M
Context128K
Q4_K_M0.0 GB
SV
svd safety l3 swift jbbsft10 remove30
Svd · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
svd safety l3 basis remove40 swapgapnet rankunit b010
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
RL
rlve opd teacher R1Distill 058 MaxDifferentGroupPairDivision 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
TI
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
group_B
Llama · tinyopsec
Params3.21B
Context128K
Q4_K_M2.0 GB
TI
Oprius 1.1B
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB