GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
AY
Aya 23 35B
Aya · itlwas
Params35B
Context8K
Q4_K_M21.5 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
Meta Llama 3.1 8B Claude Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 8B Base
Qwen · itlwas
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
dolphin 2.2.1 mistral 7b Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
MI
MiniCPM3 4B
MiniCPM · itlwas
Params4.07B
Context32K
Q4_K_M2.5 GB
LL
Llama 3.1 8B Instruct
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Stablecode Completion Alpha 3b
Stablecode · itlwas
Params2.77B
Context16K
Q4_K_M1.8 GB
TI
TinyDolphin 2.8 1.1b Q4 K M
Tinydolphin · itlwas
Params1.1B
Context4K
Q4_K_M0.7 GB
LL
Llama 3.2 1B Instruct
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLaMA O1 Base 1127 Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.1
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 8B
Qwen · itlwas
Params8.19B
Context40K
Q4_K_M5.0 GB
VI
Vikhr YandexGPT 5 Lite 8B it Q4 K M
Vikhr · itlwas
Params8.04B
Context32K
Q4_K_M4.9 GB
HU
HuatuoGPT2 13B
Huatuogpt · itlwas
Params13.9B
Context4K
Q4_K_M9.0 GB
LL
Skywork Critic Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3 1b It
Gemma · itlwas
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen2.5 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
ST
Stablecode Completion Alpha 3b 4k
Stablecode · itlwas
Params2.77B
Context4K
Q4_K_M1.8 GB
LL
Llama 68m
Llama · itlwas
Params68M
Context2K
Q4_K_M0.0 GB
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
FI
Fialka 7B v2
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen1.5 7B Chat
Qwen · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
QW
Qwen2 0.5B
Qwen · itlwas
Params494M
Context128K
Q4_K_M0.4 GB
LL
Llama 3.2 3B
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB