GGUF models by LoneStriker
163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.
LL
dolphin-2.9.1-llama-3-8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
BI
BioMistral 7B TIES
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 3 Llama 3.1 70B
Llama · LoneStriker
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
ShoriRP merged v0.57
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
SK
Skywork 13B airoboros test
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
VI
Vistral 7B ChatML
Vistral · LoneStriker
Params7.29B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-70B-Instruct-Gradient-524k
Llama · LoneStriker
Params70.6B
Context512K
Q4_K_M42.5 GB
LI
limarp miqu 1 70b
Limarp · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
GE
zephyr-7b-gemma-v0.1
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Llama3 ChatQA 1.5 8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
FU
FuseChat 7B VaRM
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Hermes 3 Llama 3.1 8B
Llama · LoneStriker
Params8.03B
Context128K
Q4_K_M4.9 GB
LO
M7 7b
Lonestriker · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-8B-Instruct-262k
Llama · LoneStriker
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
dolphin-2.9-llama3-70b
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
OpenBioLLM-Llama3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
OR
OrpoLlama 3 8B
Orpollama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Liberated Miqu 70B
Miqu · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
ST
Starling LM 7B beta
Starling · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
opus v1.2 llama 3 8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
Medorca 2x7b
Medorca · LoneStriker
Params11.1B
Context4K
Q4_K_M6.7 GB
KY
Kyllene 34B v1.1
Kyllene · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
zephyr 7b gemma sft v0.1
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.1 GB
PH
Phi 3 medium 128k instruct
Phi · LoneStriker
Params14B
Context128K
Q4_K_M8.6 GB
GO
gorilla openfunctions v2
Gorilla · LoneStriker
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Midnight Rose 103B v1.0
Midnight · LoneStriker
Params103B
Context4K
Smallest37.9 GB
NE
AlphaMonarch 7B
Neuralmonarch · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LW
LWM Text Chat 1M
Lwm · LoneStriker
Params6.74B
Context1024K
Q4_K_M4.1 GB
YI
Yi 9B 200K
Yi · LoneStriker
Params8.83B
Context256K
Q4_K_M5.3 GB
MI
mistral 7b lamia v0.1
Mistral · LoneStriker
Params7B
Context128K
Q4_K_M4.4 GB