GGUF models by larenspear

47 GGUF models quantized by larenspear on Hugging Face. Sizes run from 129M to 34.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest18.1 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest16.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest28.2 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest15.0 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest12.8 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest23.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest24.3 GB
GGUF
LL
Llama-3-Refueled
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest19.5 GB
GGUF
NU
NuminaMath 7B TIR
Numinamath · larenspear
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
WA
walledguard c
Walledguard · larenspear
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Einstein-v7-Qwen2-7B-copy
Qwen · larenspear
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-SFT-v0.1
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · larenspear
Params34.4B
Context4K
Smallest36.5 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-SFT-v0.1
Llama · larenspear
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SM
mt0 small Q2 K
Small · larenspear
Params300M
Context512
Smallest0.2 GB
GGUF
LA
T0 3B
Larenspear · larenspear
Params2.85B
Context512
Q4_K_M1.8 GB
GGUF

Keep browsing