Coding GGUF models
14916 GGUF models: models tuned for programming and code completion. Sizes run from 1M to 1780B parameters. The longest trained context is 3906K tokens.
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
PA
MS3.2 PaintedFantasy v4 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
flux2 klein 4B uncensored text encoder
Qwen · WeReCooking
Params4B
Context40K
Smallest2.4 GB
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ST
StarCoder
StarCoder · mradermacher
Params15.5B
Context8K
Q4_K_M10.0 GB
QW
Qwen3 4B toolcalling gguf codex
Qwen · Manojb
Params4B
Context256K
Smallest4.3 GB
DE
MultiPL-T-DeepSeekCoder_33b
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
PE
PentaCoder 9B
Pentacoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · wy8edhuh
Params8.19B
Context40K
Smallest5.9 GB
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
GR
Granite 8b Code Base 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
LL
ehartford_samantha-1.11-codellama-34b
Llama · TheBloke
Params33.7B
Context2K
Q4_K_M20.2 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
DA
Dans PersonalityEngine V1.1.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
KR
Kronumos Kairos v2
Kronumos · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
PY
Python Code 13B
Python · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SA
Sage A1.5 Q6 K
Sage · InternScience
Params35.5B
Context256K
Smallest29.2 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
YI
CursorCore Yi 9B i1
Yi · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama 2 Coder 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB