GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
YU
YuLan Chat 2 13b
Yulan · itlwas
Params13.2B
Context8K
Q4_K_M8.0 GB
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
EI
Einstein v2 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
QwQ 32B Preview
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
OM
OmniLing V1 8b experimental Q4 K M
Omniling · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
Deepseek Llm 7b Chat
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
PH
Phi 3 Medium 128k Instruct
Phi · itlwas
Params14B
Context128K
Q4_K_M8.6 GB
RE
Redmond Hermes Coder
Redmond · itlwas
Params15.8B
Context8K
Q4_K_M10.1 GB
NE
Nemotron 4 Mini Hindi 4b Instruct
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
AY
Aya Expanse 32b Abliterated
Aya · itlwas
Params32.3B
Context8K
Q4_K_M19.8 GB
HU
HuatuoGPT O1 8B
Huatuogpt · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.1 8b Instruct
Granite · itlwas
Params8.17B
Context128K
Q4_K_M4.9 GB
ME
Meno Tiny 0.1
Meno · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen1.5 14B
Qwen · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
QW
Qwen2 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
AR
Arch Function 3B Q4 K M
Arch · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · itlwas
Params3.23B
Context128K
Q4_K_M2.0 GB
CH
ChatWaifu_v2.0_22B
Chatwaifu · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
BI
BioMistral 7B SLERP Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
QwQ 0.5B Distilled Q4 K M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
AY
Aya Expanse 8b
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
EI
Einstein v4 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
RU
HomerCreativeAnvita Mix Qw7B
Ruadapt · itlwas
Params7.58B
Context32K
Q4_K_M4.7 GB
DA
DarkAtom 12B v3 Q4 K M
Darkatom · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · itlwas
Params3.82B
Context128K
Q4_K_M2.4 GB
AW
AwA 0.5B Q4 K M
Awa · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
AR
Arch Function 1.5B Q4 K M
Arch · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB