GGUF models by SandLogicTechnologies
98 GGUF models quantized by SandLogicTechnologies on Hugging Face. Sizes run from 164M to 70.6B parameters. The longest trained context is 1024K tokens.
LL
Llama 3.3 70B Instruct
Llama · SandLogicTechnologies
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
gemma-2-9b
Gemma · SandLogicTechnologies
Params9.24B
Context8K
Q4_K_M5.8 GB
PH
Phi 3 Mini 4k Instruct
Phi · SandLogicTechnologies
Params3.82B
Context4K
Q4_K_M2.4 GB
YI
Yi 1.5 9B Chat
Yi · SandLogicTechnologies
Params8.83B
Context4K
Q4_K_M5.3 GB
UI
Tesslate.UIGEN T2 7B
Uigen · SandLogicTechnologies
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 14B Instruct
Qwen · SandLogicTechnologies
Params14.8B
Context32K
Q4_K_M9.0 GB
ME
MedScholar 1.5B
Medscholar · SandLogicTechnologies
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
Granite 3.1 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
LL
nousresearch_nous-hermes-13b
Llama · SandLogicTechnologies
Params13B
Context2K
Q4_K_M7.9 GB
FI
TheFinAI.Fino1 8B
Fino · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
mistralai_mixtral-8x7b-v0.1
Mistral · SandLogicTechnologies
Params46.7B
Context32K
Q4_K_M26.4 GB