GGUF models by LoneStriker

163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Liberated-Qwen1.5-72B
Qwen · LoneStriker
Params72.3B
Context32K
Q4_K_M44.1 GB
CodingTool use
LL
Llama 3 Refueled
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Smaugv0.1
Mistral · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
FA
Falcon
Falcon · LoneStriker
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
MI
Midnight Rose 70B v1.0
Midnight · LoneStriker
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LW
LWM Text Chat 256K
Lwm · LoneStriker
Params6.74B
Context256K
Q4_K_M4.1 GB
GGUF
LL
OpenBioLLM-Llama3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SP
speechless zephyr code functionary 7b
Speechless · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
LL
opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 medium 4k instruct
Phi · LoneStriker
Params14B
Context4K
Q4_K_M8.6 GB
Coding
CO
Yi Coder 9B
Coder · LoneStriker
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
OP
openchat 3.5 0106 laser
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
ShoriRP merged v0.60
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
MoMo 72B lora 1.8.6 DPO
Momo · LoneStriker
Params72.3B
Context32K
Q4_K_M43.8 GB
GGUF
YI
Master-Yi-9B
Yi · LoneStriker
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
TE
Tess 10.7B v1.5
Tess · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
OrcaGemma-2B
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-64k
Llama · LoneStriker
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
SE
Sensei 7B V2
Sensei · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
wolfram miqu 1 120b
Miqu · LoneStriker
Params120B
Context32K
Smallest44.2 GB
GGUF
CO
code millenials 34b
Code · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
WE
Brezn 7b
Westseverus · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Tess-2.0-Llama-3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen1.5-110B-Chat
Qwen · LoneStriker
Params111B
Context32K
Smallest41.2 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Pantheon 10.7b
Pantheon · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MO
NeuralMonarch 7B
Monarch · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MissLizzy 7b HF
Misslizzy · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
palmer 002.5
Palmer · LoneStriker
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LW
LWM Text Chat 128K
Lwm · LoneStriker
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF

Keep browsing