GGUF models by sheldonrobinson

37 GGUF models quantized by sheldonrobinson on Hugging Face. Sizes run from 23M to 41.9B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
TE
TEN_Turn_Detection
Ten · sheldonrobinson
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CO
Codegemma 7b It
Codegemma · sheldonrobinson
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · sheldonrobinson
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context4K
Smallest1.6 GB
Tool use
QW
Qwen2.5 Math 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · sheldonrobinson
Params1.54B
Context32K
Smallest1.6 GB
CodingTool use
GE
Gemma 7b Aps It
Gemma · sheldonrobinson
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context32K
Smallest8.1 GB
CodingTool use
LL
Llama Guard 3 1B
Llama · sheldonrobinson
Params1.5B
Context128K
Smallest0.9 GB
GGUF
LL
Llama Guard 3 1B
Llama · sheldonrobinson
Params1.5B
Context128K
Smallest1.6 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context32K
Smallest8.1 GB
Tool use
SH
Shieldgemma 9b
Shieldgemma · sheldonrobinson
Params9.24B
Context8K
Smallest9.8 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · sheldonrobinson
Params3.21B
Context128K
Smallest1.9 GB
Tool use
SN
Snowflake Arctic Embed M v1.5
Snowflake · sheldonrobinson
Params109M
Context512
Smallest0.1 GB
Embedding
GE
Gemma 7b Aps It
Gemma · sheldonrobinson
Params8.54B
Context8K
Smallest9.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · sheldonrobinson
Params3.82B
Context128K
Smallest4.1 GB
Coding
GE
Gemma 2 9b It
Gemma · sheldonrobinson
Params9.24B
Context8K
Smallest9.8 GB
GGUF
AL
all MiniLM L12 v2 Q8 0
All · sheldonrobinson
Params33M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen2.5 Math 7B Instruct
Qwen · sheldonrobinson
Params7.62B
Context4K
Smallest8.1 GB
Tool use
PH
Phi 3.5 MoE Instruct
Phi · sheldonrobinson
Params41.9B
Context128K
Smallest23.6 GB
Coding
CO
Codegemma 7b It
Codegemma · sheldonrobinson
Params8.54B
Context8K
Smallest9.1 GB
GGUF
GE
Gemma 2 9b It
Gemma · sheldonrobinson
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
AL
all MiniLM L6 v2 Q4 K M
All · sheldonrobinson
Params23M
Context512
Q4_K_M0.0 GB
CodingEmbedding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · sheldonrobinson
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AL
all MiniLM L6 v2 Q8 0
All · sheldonrobinson
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
PH
Phi 3.5 Mini Instruct
Phi · sheldonrobinson
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

About sheldonrobinson on Hugging Face

sheldonrobinson has published 37 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Llama. The most downloaded are Qwen2.5 Coder 1.5B Instruct, TEN_Turn_Detection and Qwen2.5 Math 1.5B Instruct.

The quants sheldonrobinson publishes most often are Q8_0 (17), Q4_K_M (17) and Q4_0 (3). Their Q4_K_M files range from 0.0 to 25.3 GB. Parameter counts run from 23M to 41.9B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has sheldonrobinson published?

37 models are listed here, mainly from the Qwen, Gemma and Llama families. The most downloaded is Qwen2.5 Coder 1.5B Instruct.

Which quants does sheldonrobinson publish?

The most common are Q8_0 (17 models), Q4_K_M (17 models) and Q4_0 (3 models).

Keep browsing