GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Lexi Uncensored V2 Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
MI
dolphin 2.9.3 mistral 7B 32k Q4 K M
Mistral · itlwas
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MA
Magnum v2 12b
Magnum · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
GR
Granite 3b Code Base 2k
Granite · itlwas
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
QW
Qwen2.5 Coder 32B
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
PH
phi 4 Q4 K M
Phi · itlwas
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
GR
Granite 3b Code Instruct 2k
Granite · itlwas
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
SE
SeaLLMs v3 1.5B
Seallms · itlwas
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
CO
Codegemma 7b
Codegemma · itlwas
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
DE
DeepSeek Coder V2 Lite Base
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
LL
Llama 3 8B Lexi Uncensored Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stable Code 3b
Stable · itlwas
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Llama 3 8b
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stable Code Instruct 3b
Stable · itlwas
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
GR
Granite 3b Code Instruct 128k
Granite · itlwas
Params3.48B
Context125K
Q4_K_M2.1 GB
CodingTool use
QW
Qwen3 4B Base
Qwen · itlwas
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
MI
Codestral 22B v0.1
Mistral · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GE
Vikhr-Gemma-2B-instruct
Gemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen3 0.6B Base
Qwen · itlwas
Params596M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
LL
dolphin 2.9 llama3 8b Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
GR
Granite 3b Code Base 128k
Granite · itlwas
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
QW
Qwen2.5 Coder 0.5B
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
ST
Dolphincoder Starcoder2 7b
StarCoder · itlwas
Params7.4B
Context16K
Q4_K_M4.6 GB
CodingTool use
LL
Llama 3 8B LexiFun Uncensored V1 Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
Qwen2.5 Coder 32B Instruct
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
ST
Dolphincoder Starcoder2 15b
StarCoder · itlwas
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
QW
Qwen2.5 1.5B Instruct
Qwen · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Keep browsing