GGUF models by SandLogicTechnologies
98 GGUF models quantized by SandLogicTechnologies on Hugging Face. Sizes run from 164M to 70.6B parameters. The longest trained context is 1024K tokens.
NX
Nxcode-CQ-7B-orpo
Nxcode · SandLogicTechnologies
Params7.25B
Context64K
Q4_K_M4.7 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
GR
granite 4.1 3b
Granite · SandLogicTechnologies
Params3.4B
Context128K
Smallest1.6 GB
SQ
sqlcoder 7b 2
Sqlcoder · SandLogicTechnologies
Params6.74B
Context16K
Smallest3.1 GB
MI
Ministral 3 8B Instruct 2512
Mistral · SandLogicTechnologies
Params8.49B
Context256K
Q4_K_M5.2 GB
GE
Gemma 3 270m
Gemma · SandLogicTechnologies
Params268M
Context32K
Q4_K_M0.3 GB
QW
Qwen3 4B Thinking 2507
Qwen · SandLogicTechnologies
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Gemma 4 12B It
Gemma · SandLogicTechnologies
Params11.9B
Context256K
Smallest5.7 GB
MI
Mistral 7B Instruct v0.3
Mistral · SandLogicTechnologies
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Gemma 7b
Gemma · SandLogicTechnologies
Params8.54B
Context8K
Q4_K_M5.3 GB
NE
OpenReasoning Nemotron 7B
Nemotron · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 3 1b It
Gemma · SandLogicTechnologies
Params1B
Context32K
Q4_K_M0.8 GB
OP
openchat 3.6 8b 20240522
Openchat · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 9B
Qwen · SandLogicTechnologies
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi-4-Mini-Reasoning
Phi · SandLogicTechnologies
Params3.84B
Context128K
Q4_K_M2.5 GB
EM
Embeddinggemma 300m
Embeddinggemma · SandLogicTechnologies
Params303M
Context2K
Q4_K_M0.2 GB
FA
Falcon3 7B Base
Falcon · SandLogicTechnologies
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
Llama 3.1 Tulu 3 8B
Llama · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.1 8b
Granite · SandLogicTechnologies
Params8.79B
Context128K
Smallest4.1 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
GR
Granite 3.3 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
LL
llama 2 13b chat
Llama · SandLogicTechnologies
Params13B
Context4K
Q4_K_M7.9 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · SandLogicTechnologies
Params8.49B
Context256K
Smallest4.0 GB
SO
SOLAR 10.7B v1.0
Solar · SandLogicTechnologies
Params10.7B
Context4K
Q4_K_M6.5 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · SandLogicTechnologies
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 Math 1.5B
Qwen · SandLogicTechnologies
Params1.54B
Context4K
Q4_K_M1.0 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Magistral-Small-2506
Mistral · SandLogicTechnologies
Params23.6B
Context40K
Smallest13.5 GB
GR
Granite Guardian 4.1 8b
Granite · SandLogicTechnologies
Params8.38B
Context128K
Smallest3.9 GB