GGUF models by LoneStriker

163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
Fimbulvetr 10.7B v1
Fimbulvetr · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · LoneStriker
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SK
Skywork 13B Airo Claude Pippa Puffin
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
CR
Crunchy onion
Crunchy · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
Yi 6B 200K Airo Claude Puffin
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
OP
OpenCodeInterpreter CL 70B
Opencodeinterpreter · LoneStriker
Params69B
Context16K
Q4_K_M41.4 GB
Coding
GE
gemma-2b-it
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
OP
OpenHermes 2.5 Code 290k 13B
Openhermes · LoneStriker
Params13B
Context4K
Q4_K_M7.9 GB
CodingTool use
MI
CapybaraHermes 2.5 Mistral 7B
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
gemma-7b-it
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
OP
OpenCodeInterpreter CL 13B
Opencodeinterpreter · LoneStriker
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
MixTAO-7Bx2-MoE-v8.1
Mixtao · LoneStriker
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
WE
WestLake 7B v2 laser truthy dpo
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
openbuddy-gemma-7b-v19.1-4k
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
WE
WestLake 7B v2
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · LoneStriker
Params236B
Context160K
Q4_K_M142.5 GB
Coding
BI
BioMistral 7B SLERP
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
DistilabelBeagle14 7B
Beagle · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral7B-PairRM-SPPO
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SK
Skywork 13B Spicyboros 3.1
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
LL
Llama3 ChatQA 1.5 70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
bagel-7b-v0.5
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
SA
SambaLingo Japanese Chat
Sambalingo · LoneStriker
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
WE
WestLake 7B v2 laser
Westlake · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · LoneStriker
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
VI
vinallama 7b
Vinallama · LoneStriker
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
CO
CodeMate v0.1
Codemate · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
BI
BioMistral 7B DARE
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing