GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
EI
Einstein v5 v0.2 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Yi Coder 9B Chat
Coder · itlwas
Params8.83B
Context128K
Q4_K_M5.3 GB
LL
Reasoning Llama 3b v0.2 Q4 K M
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
SA
Sailor 14B
Sailor · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
GR
Granite 3.1 8b Base
Granite · itlwas
Params8.17B
Context128K
Q4_K_M4.9 GB
OL
OLMo 2 1124 13B Instruct
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
QW
QwQ Math IO 500M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
IN
Internlm2 Math 20b
InternLM · itlwas
Params19.9B
Context8K
Q4_K_M12.0 GB
LL
Reasoning Llama 1b v0.1
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
IN
Internlm2_5 7b
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
KU
Kurage Ru
Kurage · itlwas
Params7.61B
Context32K
Q4_K_M4.7 GB
MA
Maral Q4 K M
Maral · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
AV
Ava 1.0 8B Q4 K M
Ava · itlwas
Params8.02B
Context32K
Q4_K_M4.9 GB
NE
neo 7b Q4 K M
Neo · itlwas
Params7.79B
Context8K
Q4_K_M4.7 GB
IN
Internlm2_5 7b Chat 1m
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
SM
SmolLM2 1.7B
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
DE
Devple 8B Q4 K M
Devple · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Salt 116k
Salt · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
GR
Granite 3.1 2b Base
Granite · itlwas
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen2.5 32B AGI
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
QwQ MathOct 7B Q4 K M
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
AB
AbominationScience 12B v4 Q4 K M
Abominationscience · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QV
QVikhr 2.5 1.5B Instruct SMPO Q4 K M
Qvikhr · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
EI
Einstein 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
Pythia 160m
Pythia · itlwas
Params162M
Context2K
Q4_K_M0.1 GB