GGUF models by jacobcarajo
55 GGUF models quantized by jacobcarajo on Hugging Face. Sizes run from 494M to 34.7B parameters. The longest trained context is 256K tokens.
QW
Qwen2.5 Math 7B Instruct
Qwen · jacobcarajo
Params7.62B
Context4K
Smallest5.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
DE
Deepseek Coder 33b Instruct
DeepSeek · jacobcarajo
Params33.3B
Context16K
Smallest23.5 GB
QW
Qwen3.8 27B
Qwen · jacobcarajo
Params27.3B
Context256K
Smallest19.5 GB
MI
Codestral 22B v0.1
Mistral · jacobcarajo
Params22.2B
Context32K
Smallest15.7 GB
PH
Phi 3.5 Mini Instruct
Phi · jacobcarajo
Params3.82B
Context128K
Smallest2.8 GB
GE
Gemma 3 27b It
Gemma · jacobcarajo
Params27B
Context128K
Smallest19.3 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · jacobcarajo
Params30.5B
Context256K
Smallest21.7 GB
DE
Deepseek Math 7b Instruct
DeepSeek · jacobcarajo
Params6.91B
Context4K
Smallest4.9 GB
QW
Qwen2 0.5B
Qwen · jacobcarajo
Params494M
Context128K
Q4_K_M0.4 GB
MI
Ministral 8B Instruct 2410
Mistral · jacobcarajo
Params8.02B
Context32K
Smallest5.7 GB
PH
Phi 4 Reasoning Plus
Phi · jacobcarajo
Params14.7B
Context32K
Smallest10.6 GB
QW
CodeQwen1.5 7B
Qwen · jacobcarajo
Params7.25B
Context64K
Smallest5.4 GB
LL
OpenMath2 Llama3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
LL
CodeLlama 13b Python Hf
Llama · jacobcarajo
Params13B
Context16K
Smallest9.2 GB
CO
Codegemma 1.1 7b It
Codegemma · jacobcarajo
Params8.54B
Context8K
Smallest6.1 GB
WI
WizardCoder 33B V1.1
Wizardcoder · jacobcarajo
Params33.3B
Context16K
Smallest23.5 GB
GE
Gemma 2 27b It
Gemma · jacobcarajo
Params27.2B
Context8K
Smallest19.4 GB
QW
Qwen3 32B
Qwen · jacobcarajo
Params32.8B
Context40K
Smallest23.2 GB
LL
Phind CodeLlama 34B Python v1
Llama · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
LL
Meta Llama 3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
starcoder2 15b instruct v0.1 Q5 K M
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB
MI
Mathstral 7B v0.1 Q5 K M
Mistral · jacobcarajo
Params7.25B
Context32K
Smallest5.1 GB
ST
Dolphincoder Starcoder2 15b
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB
ST
Starcoder2 15b
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB