GGUF models by LoneStriker
163 GGUF models quantized by LoneStriker on Hugging Face. Sizes run from 1.1B to 236B parameters. The longest trained context is 1024K tokens.
QW
Liberated-Qwen1.5-72B
Qwen · LoneStriker
Params72.3B
Context32K
Q4_K_M44.1 GB
LL
Llama 3 Refueled
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Smaugv0.1
Mistral · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
FA
Falcon
Falcon · LoneStriker
Params11.1B
Context2K
Q4_K_M6.8 GB
MI
Midnight Rose 70B v1.0
Midnight · LoneStriker
Params69B
Context4K
Q4_K_M41.4 GB
LW
LWM Text Chat 256K
Lwm · LoneStriker
Params6.74B
Context256K
Q4_K_M4.1 GB
LL
OpenBioLLM-Llama3-8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
SP
speechless zephyr code functionary 7b
Speechless · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 medium 4k instruct
Phi · LoneStriker
Params14B
Context4K
Q4_K_M8.6 GB
CO
Yi Coder 9B
Coder · LoneStriker
Params8.83B
Context128K
Q4_K_M5.3 GB
OP
openchat 3.5 0106 laser
Openchat · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
ShoriRP merged v0.60
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
MoMo 72B lora 1.8.6 DPO
Momo · LoneStriker
Params72.3B
Context32K
Q4_K_M43.8 GB
YI
Master-Yi-9B
Yi · LoneStriker
Params8.83B
Context4K
Q4_K_M5.3 GB
TE
Tess 10.7B v1.5
Tess · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
OrcaGemma-2B
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Meta-Llama-3-8B-Instruct-64k
Llama · LoneStriker
Params8.03B
Context64K
Q4_K_M4.9 GB
SE
Sensei 7B V2
Sensei · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
wolfram miqu 1 120b
Miqu · LoneStriker
Params120B
Context32K
Smallest44.2 GB
CO
code millenials 34b
Code · LoneStriker
Params33.7B
Context16K
Q4_K_M20.2 GB
WE
Brezn 7b
Westseverus · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Tess-2.0-Llama-3-70B
Llama · LoneStriker
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen1.5-110B-Chat
Qwen · LoneStriker
Params111B
Context32K
Smallest41.2 GB
LL
Llama 3 Smaug 8B
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
Pantheon 10.7b
Pantheon · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
MO
NeuralMonarch 7B
Monarch · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MissLizzy 7b HF
Misslizzy · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
palmer 002.5
Palmer · LoneStriker
Params1.1B
Context2K
Q4_K_M0.7 GB
LW
LWM Text Chat 128K
Lwm · LoneStriker
Params6.74B
Context128K
Q4_K_M4.1 GB