GGUF models by LoneStriker

163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
Senku 70B Full
Senku · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
GE
Gemmalpaca-2B
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
YI
Yi 6B 200K
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
SK
SkunkApe-14b
Skunkape · LoneStriker
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
LL
airoboros-70b-3.3
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
RoleplayTool use
LW
LWM Text Chat 512K
Lwm · LoneStriker
Params6.74B
Context512K
Q4_K_M4.1 GB
GGUF
QW
Qwen1.5 8x7b
Qwen · LoneStriker
Params38B
Context32K
Q4_K_M23.6 GB
GGUF
TE
Tess 10.7B v1.5b
Tess · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Meta-Llama-3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mixtral_7Bx5_MoE_30B
Mistral · LoneStriker
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
BI
BioMistral 7B
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Buzz-8b-Large-v0.5
Neural · LoneStriker
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
bagel 8b v1.0
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
FU
FuseChat 7B Slerp
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · LoneStriker
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
NA
natural functions
Natural · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
Newton 7B
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-70B-Instruct-Gradient-262k
Llama · LoneStriker
Params70.6B
Context256K
Q4_K_M42.5 GB
GGUF
BA
bagel 34b v0.4
Bagel · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplayTool use
GE
gemma-1.1-7b-it
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · LoneStriker
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Einstein v4 7B
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
YI
Yi-1.5-34B-32K
Yi · LoneStriker
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
FU
FuseChat 7B TA
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B 16K
Llama · LoneStriker
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
QU
Quyen-Pro-Max-v0.1
Quyen · LoneStriker
Params72.3B
Context32K
Q4_K_M44.1 GB
Tool use
LL
Tess-2.0-Llama-3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · LoneStriker
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
MI
openbuddy mistral 7b v17.1 32k
Mistral · LoneStriker
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing