GGUF models by LoneStriker
163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.
SE
Senku 70B Full
Senku · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
GE
Gemmalpaca-2B
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
YI
Yi 6B 200K
Yi · LoneStriker
Params6.06B
Context195K
Q4_K_M3.7 GB
SK
SkunkApe-14b
Skunkape · LoneStriker
Params14.2B
Context8K
Q4_K_M8.6 GB
LL
airoboros-70b-3.3
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
LW
LWM Text Chat 512K
Lwm · LoneStriker
Params6.74B
Context512K
Q4_K_M4.1 GB
QW
Qwen1.5 8x7b
Qwen · LoneStriker
Params38B
Context32K
Q4_K_M23.6 GB
TE
Tess 10.7B v1.5b
Tess · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Meta-Llama-3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtral_7Bx5_MoE_30B
Mistral · LoneStriker
Params29.8B
Context32K
Q4_K_M18.0 GB
BI
BioMistral 7B
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Buzz-8b-Large-v0.5
Neural · LoneStriker
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
bagel 8b v1.0
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
FU
FuseChat 7B Slerp
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409
Mistral · LoneStriker
Params22.2B
Context128K
Q4_K_M13.3 GB
NA
natural functions
Natural · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Newton 7B
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama-3-70B-Instruct-Gradient-262k
Llama · LoneStriker
Params70.6B
Context256K
Q4_K_M42.5 GB
BA
bagel 34b v0.4
Bagel · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
gemma-1.1-7b-it
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · LoneStriker
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
Meta Llama 3 70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Einstein v4 7B
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi-1.5-34B-32K
Yi · LoneStriker
Params34.4B
Context32K
Q4_K_M20.7 GB
FU
FuseChat 7B TA
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3 8B 16K
Llama · LoneStriker
Params8.03B
Context16K
Q4_K_M4.9 GB
QU
Quyen-Pro-Max-v0.1
Quyen · LoneStriker
Params72.3B
Context32K
Q4_K_M44.1 GB
LL
Tess-2.0-Llama-3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · LoneStriker
Params70.6B
Context32K
Q4_K_M42.5 GB
MI
openbuddy mistral 7b v17.1 32k
Mistral · LoneStriker
Params7.28B
Context32K
Q4_K_M4.4 GB