GGUF models by AlSamCur123
53 GGUF models quantized by AlSamCur123 on Hugging Face. Sizes run from 1.24B to 32.8B parameters. The longest trained context is 1000K tokens.
MI
DeepHermes 3 Mistral 24
Mistral · AlSamCur123
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
gemma finetune
Gemma · AlSamCur123
Params27B
Context128K
Smallest15.6 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · AlSamCur123
Params23.6B
Context128K
Smallest13.4 GB
LL
Llama 3.2 1B
Llama · AlSamCur123
Params1.24B
Context128K
Smallest0.8 GB
MI
NemoFineTune
Mistral · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.2 1B InstructContinuedFine
Llama · AlSamCur123
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
Deepseek R1 Distill Qwen 14b Unsloth Bnb 4bit
DeepSeek · AlSamCur123
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi4
Phi · AlSamCur123
Params14.7B
Context32K
Q4_K_M8.9 GB
MI
Mistral3InstructContinuedFine
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 1B Instruct
Llama · AlSamCur123
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LlamaChatml
Llama · AlSamCur123
Params13B
Context31K
Q4_K_M7.9 GB
MI
MistralSmall22bAlpaca
Mistral · AlSamCur123
Params22.2B
Context128K
Q4_K_M13.3 GB
NE
NemoAlpacaNewest
Nemotunecontinuedfine · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
OS
OSS
Oss · AlSamCur123
Params20.9B
Context128K
Smallest13.8 GB
MI
Mistral 7b Instruct FineTune
Mistral · AlSamCur123
Params7.25B
Context32K
Smallest4.1 GB
LL
Llama 3.2 3B
Llama · AlSamCur123
Params3.21B
Context128K
Smallest1.9 GB
MI
MistralSmall 3.1 24b 2506
Mistral · AlSamCur123
Params23.6B
Context40K
Q4_K_M14.3 GB
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · AlSamCur123
Params3.82B
Context128K
Q4_K_M2.3 GB
MI
Mistral3R1
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Instruct v0.3
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
DeepHermes 3 Mistral 24BChatML
Mistral · AlSamCur123
Params23.6B
Context32K
Q4_K_M14.3 GB
NE
NemoUnslothExpimentalSettings
Nemounslothexpimentalsettings · AlSamCur123
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7b Instruct v0.3 R1
Mistral · AlSamCur123
Params7.25B
Context32K
Q4_K_M4.4 GB