GGUF models by LoneStriker
163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.
FI
Fimbulvetr 10.7B v1
Fimbulvetr · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · LoneStriker
Params6.74B
Context16K
Q4_K_M4.1 GB
SK
Skywork 13B Airo Claude Pippa Puffin
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
CR
Crunchy onion
Crunchy · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Yi 6B 200K Airo Claude Puffin
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
OP
OpenCodeInterpreter CL 70B
Opencodeinterpreter · LoneStriker
Params69B
Context16K
Q4_K_M41.4 GB
GE
gemma-2b-it
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
OP
OpenHermes 2.5 Code 290k 13B
Openhermes · LoneStriker
Params13B
Context4K
Q4_K_M7.9 GB
MI
CapybaraHermes 2.5 Mistral 7B
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma-7b-it
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
OP
OpenCodeInterpreter CL 13B
Opencodeinterpreter · LoneStriker
Params13B
Context16K
Q4_K_M7.9 GB
MI
MixTAO-7Bx2-MoE-v8.1
Mixtao · LoneStriker
Params12.9B
Context32K
Q4_K_M7.8 GB
WE
WestLake 7B v2 laser truthy dpo
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
openbuddy-gemma-7b-v19.1-4k
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
WE
WestLake 7B v2
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · LoneStriker
Params236B
Context160K
Q4_K_M142.5 GB
BI
BioMistral 7B SLERP
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
DistilabelBeagle14 7B
Beagle · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta-Llama-3-70B-Instruct
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Meta-Llama-3-8B-Instruct
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral7B-PairRM-SPPO
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
SK
Skywork 13B Spicyboros 3.1
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
LL
Llama3 ChatQA 1.5 70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
bagel-7b-v0.5
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SambaLingo Japanese Chat
Sambalingo · LoneStriker
Params6.95B
Context4K
Q4_K_M4.2 GB
WE
WestLake 7B v2 laser
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · LoneStriker
Params34.4B
Context8K
Q4_K_M20.7 GB
VI
vinallama 7b
Vinallama · LoneStriker
Params6.86B
Context4K
Q4_K_M4.2 GB
CO
CodeMate v0.1
Codemate · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
BI
BioMistral 7B DARE
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB