GGUF models by jacobcarajo

55 GGUF models quantized by jacobcarajo on Hugging Face. Sizes run from 494M to 34.7B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Math 7B Instruct
Qwen · jacobcarajo
Params7.62B
Context4K
Smallest5.4 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Tool use
DE
Deepseek Coder 33b Instruct
DeepSeek · jacobcarajo
Params33.3B
Context16K
Smallest23.5 GB
Coding
QW
Qwen3.8 27B
Qwen · jacobcarajo
Params27.3B
Context256K
Smallest19.5 GB
ReasoningTool useVision
MI
Codestral 22B v0.1
Mistral · jacobcarajo
Params22.2B
Context32K
Smallest15.7 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · jacobcarajo
Params3.82B
Context128K
Smallest2.8 GB
Coding
GE
Gemma 3 27b It
Gemma · jacobcarajo
Params27B
Context128K
Smallest19.3 GB
Vision
QW
Qwen3 30B A3B Thinking 2507
Qwen · jacobcarajo
Params30.5B
Context256K
Smallest21.7 GB
ReasoningTool use
DE
Deepseek Math 7b Instruct
DeepSeek · jacobcarajo
Params6.91B
Context4K
Smallest4.9 GB
GGUF
QW
Qwen2 0.5B
Qwen · jacobcarajo
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · jacobcarajo
Params8.02B
Context32K
Smallest5.7 GB
Tool use
PH
Phi 4 Reasoning Plus
Phi · jacobcarajo
Params14.7B
Context32K
Smallest10.6 GB
CodingReasoning
QW
CodeQwen1.5 7B
Qwen · jacobcarajo
Params7.25B
Context64K
Smallest5.4 GB
GGUF
LL
OpenMath2 Llama3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
CodeLlama 13b Python Hf
Llama · jacobcarajo
Params13B
Context16K
Smallest9.2 GB
Coding
CO
Codegemma 1.1 7b It
Codegemma · jacobcarajo
Params8.54B
Context8K
Smallest6.1 GB
GGUF
WI
WizardCoder 33B V1.1
Wizardcoder · jacobcarajo
Params33.3B
Context16K
Smallest23.5 GB
Coding
GE
Gemma 2 27b It
Gemma · jacobcarajo
Params27.2B
Context8K
Smallest19.4 GB
GGUF
QW
Qwen3 32B
Qwen · jacobcarajo
Params32.8B
Context40K
Smallest23.2 GB
ReasoningTool use
LL
Phind CodeLlama 34B Python v1
Llama · jacobcarajo
Params33.7B
Context16K
Smallest23.8 GB
Coding
LL
Meta Llama 3.1 8B
Llama · jacobcarajo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
starcoder2 15b instruct v0.1 Q5 K M
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB
Coding
MI
Mathstral 7B v0.1 Q5 K M
Mistral · jacobcarajo
Params7.25B
Context32K
Smallest5.1 GB
GGUF
ST
Dolphincoder Starcoder2 15b
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB
CodingTool use
ST
Starcoder2 15b
StarCoder · jacobcarajo
Params16B
Context16K
Smallest11.4 GB
Coding

Keep browsing