GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
EI
Einstein v5 v0.2 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CO
Yi Coder 9B Chat
Coder · itlwas
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
LL
Reasoning Llama 3b v0.2 Q4 K M
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
SA
Sailor 14B
Sailor · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
GR
Granite 3.1 8b Base
Granite · itlwas
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
OL
OLMo 2 1124 13B Instruct
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
QwQ Math IO 500M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
IN
Internlm2 Math 20b
InternLM · itlwas
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
IN
Internlm2_5 7b
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
KU
Kurage Ru
Kurage · itlwas
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
MA
Maral Q4 K M
Maral · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AV
Ava 1.0 8B Q4 K M
Ava · itlwas
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
NE
neo 7b Q4 K M
Neo · itlwas
Params7.79B
Context8K
Q4_K_M4.7 GB
GGUF
IN
Internlm2_5 7b Chat 1m
InternLM · itlwas
Params7.74B
Context256K
Q4_K_M4.7 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
DE
Devple 8B Q4 K M
Devple · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
Salt 116k
Salt · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GR
Granite 3.1 2b Base
Granite · itlwas
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Qwen2.5 32B AGI
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
QwQ MathOct 7B Q4 K M
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
AB
AbominationScience 12B v4 Q4 K M
Abominationscience · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QV
QVikhr 2.5 1.5B Instruct SMPO Q4 K M
Qvikhr · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
EI
Einstein 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 160m
Pythia · itlwas
Params162M
Context2K
Q4_K_M0.1 GB
GGUF

Keep browsing