GGUF models by AlSamCur123

53 GGUF models quantized by AlSamCur123 on Hugging Face. Sizes run from 1.24B to 32.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
DeepHermes 3 Mistral 24
Mistral · AlSamCur123
Params23.6B
Context32K
Q4_K_M14.3 GB
Tool use
GE
gemma finetune
Gemma · AlSamCur123
Params27B
Context128K
Smallest15.6 GB
Vision
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · AlSamCur123
Params23.6B
Context128K
Smallest13.4 GB
Tool useVision
LL
Llama 3.2 1B
Llama · AlSamCur123
Params1.24B
Context128K
Smallest0.8 GB
Tool use
MI
NemoFineTune
Mistral · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Llama 3.2 1B InstructContinuedFine
Llama · AlSamCur123
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
DE
Deepseek R1 Distill Qwen 14b Unsloth Bnb 4bit
DeepSeek · AlSamCur123
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
PH
Phi4
Phi · AlSamCur123
Params14.7B
Context32K
Q4_K_M8.9 GB
GGUF
MI
Mistral3InstructContinuedFine
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · AlSamCur123
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
LlamaChatml
Llama · AlSamCur123
Params13B
Context31K
Q4_K_M7.9 GB
GGUF
MI
MistralSmall22bAlpaca
Mistral · AlSamCur123
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
NE
NemoAlpacaNewest
Nemotunecontinuedfine · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
OS
OSS
Oss · AlSamCur123
Params20.9B
Context128K
Smallest13.8 GB
Tool use
MI
Mistral 7b Instruct FineTune
Mistral · AlSamCur123
Params7.25B
Context32K
Smallest4.1 GB
Tool use
LL
Llama 3.2 3B
Llama · AlSamCur123
Params3.21B
Context128K
Smallest1.9 GB
Tool use
MI
MistralSmall 3.1 24b 2506
Mistral · AlSamCur123
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · AlSamCur123
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
MI
Mistral3R1
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7b Instruct v0.3
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
DeepHermes 3 Mistral 24BChatML
Mistral · AlSamCur123
Params23.6B
Context32K
Q4_K_M14.3 GB
Tool use
NE
NemoUnslothExpimentalSettings
Nemounslothexpimentalsettings · AlSamCur123
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7b Instruct v0.3 R1
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
ReasoningTool use

Keep browsing