GGUF models by LoneStriker

163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
dolphin-2.9.1-llama-3-8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
BI
BioMistral 7B TIES
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · LoneStriker
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
MI
ShoriRP merged v0.57
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SK
Skywork 13B airoboros test
Skywork · LoneStriker
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
VI
Vistral 7B ChatML
Vistral · LoneStriker
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-70B-Instruct-Gradient-524k
Llama · LoneStriker
Params70.6B
Context512K
Q4_K_M42.5 GB
GGUF
LI
limarp miqu 1 70b
Limarp · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
GE
zephyr-7b-gemma-v0.1
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama3 ChatQA 1.5 8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FU
FuseChat 7B VaRM
Fusechat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · LoneStriker
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LO
M7 7b
Lonestriker · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-8B-Instruct-262k
Llama · LoneStriker
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
OpenBioLLM-Llama3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OR
OrpoLlama 3 8B
Orpollama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Liberated Miqu 70B
Miqu · LoneStriker
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
ST
Starling LM 7B beta
Starling · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
opus v1.2 llama 3 8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Medorca 2x7b
Medorca · LoneStriker
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
KY
Kyllene 34B v1.1
Kyllene · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GE
zephyr 7b gemma sft v0.1
Gemma · LoneStriker
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · LoneStriker
Params14B
Context128K
Q4_K_M8.6 GB
Coding
GO
gorilla openfunctions v2
Gorilla · LoneStriker
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Midnight Rose 103B v1.0
Midnight · LoneStriker
Params103B
Context4K
Smallest37.9 GB
GGUF
NE
AlphaMonarch 7B
Neuralmonarch · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LW
LWM Text Chat 1M
Lwm · LoneStriker
Params6.74B
Context1024K
Q4_K_M4.1 GB
GGUF
YI
Yi 9B 200K
Yi · LoneStriker
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
MI
mistral 7b lamia v0.1
Mistral · LoneStriker
Params7B
Context128K
Q4_K_M4.4 GB
Roleplay

Keep browsing