GGUF models by LoneStriker

163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
deepseek coder 7b instruct v1.5
DeepSeek · LoneStriker
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · LoneStriker
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
CodeFuse DeepSeek 33B
DeepSeek · LoneStriker
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
MI
Air Striker Mixtral 8x7B Instruct ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
internlm2 math 20b llama
Llama · LoneStriker
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
DE
openbuddy deepseek 10b v17.1 4k
DeepSeek · LoneStriker
Params10.6B
Context4K
Q4_K_M6.4 GB
GGUF
DE
DeepMagic Coder 7b Alt
Deepmagic · LoneStriker
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
OP
OpenCodeInterpreter DS 33B
Opencodeinterpreter · LoneStriker
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
deepseek llm 67b Spicy 3.1 1
DeepSeek · LoneStriker
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
SE
SeaLLM 7B v2
Seallm · LoneStriker
Params7.38B
Context32K
Q4_K_M4.5 GB
GGUF
LL
CodeLlama 70b Instruct hf
Llama · LoneStriker
Params69B
Context2K
Q4_K_M41.4 GB
Coding
GE
gemma-2b
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
openbuddy-mixtral-7bx8-v18.1-32k
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.5 GB
GGUF
TO
TowerInstruct 13B v0.1
Towerinstruct · LoneStriker
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
kellemar DPO Orca Distilled 7B SLERP
Marcoro · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
GE
gemma-7b
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
DE
DeepMagic Coder 7b
Deepmagic · LoneStriker
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
OP
OpenCodeInterpreter CL 7B
Opencodeinterpreter · LoneStriker
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Synatra Mixtral 8x7B
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PH
Wiedervereinigung 7b dpo
Phoenix · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 70b Python hf
Llama · LoneStriker
Params69B
Context2K
Q4_K_M41.4 GB
Coding
BL
Blue Orchid 2x7b
Blue · LoneStriker
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
UM
Umbra v2.1 MoE 4x10.7
Umbra · LoneStriker
Params36.1B
Context32K
Q4_K_M21.8 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · LoneStriker
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
EV
Everyone Coder 33b v2 Base
Everyone · LoneStriker
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
BA
bagel dpo 7b v0.4
Bagel · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplayTool use
CO
Yi Coder 9B Chat
Coder · LoneStriker
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
KA
KafkaLM 8x7b German V0.1 DPO
Kafkalm · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF

About LoneStriker on Hugging Face

LoneStriker has published 163 GGUF models that ggufmodels.com tracks, across families such as Llama, Mistral and Gemma. The most downloaded are deepseek coder 7b instruct v1.5, DeepSeek-Coder-V2-Lite-Instruct and Mistral 7B Instruct v0.2 Neural Story.

The quants LoneStriker publishes most often are Q4_K_M (159), Q3_K_L (154), Q5_K_M (149) and Q6_K (138). Their Q4_K_M files range from 0.7 to 142.5 GB. Parameter counts run from 1.1B to 236B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has LoneStriker published?

163 models are listed here, mainly from the Llama, Mistral and Gemma families. The most downloaded is deepseek coder 7b instruct v1.5.

Which quants does LoneStriker publish?

The most common are Q4_K_M (159 models), Q3_K_L (154 models), Q5_K_M (149 models) and Q6_K (138 models).

Keep browsing