GGUF models by SandLogicTechnologies

98 GGUF models quantized by SandLogicTechnologies on Hugging Face. Sizes run from 164M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NX
Nxcode-CQ-7B-orpo
Nxcode · SandLogicTechnologies
Params7.25B
Context64K
Q4_K_M4.7 GB
Coding
ME
Mellum2 12B A2.5B Instruct
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
CodingTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
CodingReasoningTool use
GR
granite 4.1 3b
Granite · SandLogicTechnologies
Params3.4B
Context128K
Smallest1.6 GB
ReasoningTool use
SQ
sqlcoder 7b 2
Sqlcoder · SandLogicTechnologies
Params6.74B
Context16K
Smallest3.1 GB
Coding
MI
Ministral 3 8B Instruct 2512
Mistral · SandLogicTechnologies
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
GE
Gemma 3 270m
Gemma · SandLogicTechnologies
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
QW
Qwen3 4B Thinking 2507
Qwen · SandLogicTechnologies
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
GE
Gemma 4 12B It
Gemma · SandLogicTechnologies
Params11.9B
Context256K
Smallest5.7 GB
ReasoningTool useVision
MI
Mistral 7B Instruct v0.3
Mistral · SandLogicTechnologies
Params7.25B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
GE
Gemma 7b
Gemma · SandLogicTechnologies
Params8.54B
Context8K
Q4_K_M5.3 GB
Reasoning
NE
OpenReasoning Nemotron 7B
Nemotron · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
GE
Gemma 3 1b It
Gemma · SandLogicTechnologies
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
OP
openchat 3.6 8b 20240522
Openchat · SandLogicTechnologies
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
QW
Qwen3.5 9B
Qwen · SandLogicTechnologies
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
PH
Phi-4-Mini-Reasoning
Phi · SandLogicTechnologies
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
EM
Embeddinggemma 300m
Embeddinggemma · SandLogicTechnologies
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
FA
Falcon3 7B Base
Falcon · SandLogicTechnologies
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
LL
Llama 3.1 Tulu 3 8B
Llama · SandLogicTechnologies
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.1 8b
Granite · SandLogicTechnologies
Params8.79B
Context128K
Smallest4.1 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
GR
Granite 3.3 8b Instruct
Granite · SandLogicTechnologies
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama 2 13b chat
Llama · SandLogicTechnologies
Params13B
Context4K
Q4_K_M7.9 GB
Reasoning
MI
Ministral 3 8B Reasoning 2512
Mistral · SandLogicTechnologies
Params8.49B
Context256K
Smallest4.0 GB
ReasoningTool useVision
SO
SOLAR 10.7B v1.0
Solar · SandLogicTechnologies
Params10.7B
Context4K
Q4_K_M6.5 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · SandLogicTechnologies
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen2.5 Math 1.5B
Qwen · SandLogicTechnologies
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
Magistral-Small-2506
Mistral · SandLogicTechnologies
Params23.6B
Context40K
Smallest13.5 GB
Reasoning
GR
Granite Guardian 4.1 8b
Granite · SandLogicTechnologies
Params8.38B
Context128K
Smallest3.9 GB
ReasoningTool use

Keep browsing