GGUF models by SandLogicTechnologies

98 GGUF models quantized by SandLogicTechnologies on Hugging Face. Sizes run from 164M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.3 70B Instruct
Llama · SandLogicTechnologies
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GE
gemma-2-9b
Gemma · SandLogicTechnologies
Params9.24B
Context8K
Q4_K_M5.8 GB
Reasoning
PH
Phi 3 Mini 4k Instruct
Phi · SandLogicTechnologies
Params3.82B
Context4K
Q4_K_M2.4 GB
Reasoning
YI
Yi 1.5 9B Chat
Yi · SandLogicTechnologies
Params8.83B
Context4K
Q4_K_M5.3 GB
Reasoning
UI
Tesslate.UIGEN T2 7B
Uigen · SandLogicTechnologies
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 14B Instruct
Qwen · SandLogicTechnologies
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
ME
MedScholar 1.5B
Medscholar · SandLogicTechnologies
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
LL
nousresearch_nous-hermes-13b
Llama · SandLogicTechnologies
Params13B
Context2K
Q4_K_M7.9 GB
ReasoningTool use
FI
TheFinAI.Fino1 8B
Fino · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
MI
mistralai_mixtral-8x7b-v0.1
Mistral · SandLogicTechnologies
Params46.7B
Context32K
Q4_K_M26.4 GB
Reasoning

Keep browsing