GGUF models by larenspear
47 GGUF models quantized by larenspear on Hugging Face. Sizes run from 129M to 34.4B parameters. The longest trained context is 1024K tokens.
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest18.1 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest16.7 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest28.2 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest15.0 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest12.8 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest23.7 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest24.3 GB
LL
Llama-3-Refueled
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest19.5 GB
NU
NuminaMath 7B TIR
Numinamath · larenspear
Params6.91B
Context4K
Q4_K_M4.2 GB
WA
walledguard c
Walledguard · larenspear
Params494M
Context32K
Q4_K_M0.4 GB
QW
Einstein-v7-Qwen2-7B-copy
Qwen · larenspear
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama-3-8B-Magpie-Pro-SFT-v0.1
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest36.5 GB
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
mt0 small Q2 K
Small · larenspear
Params300M
Context512
Smallest0.2 GB
LA
T0 3B
Larenspear · larenspear
Params2.85B
Context512
Q4_K_M1.8 GB