Python EOL Versions

[pvickery-ParamountCommerce]

Topic

Airbyte includes Python 2.7.18 which hit EOL 5 years ago

Relevant information

Some airbyte containers are using an old version of python which has hit EOL in 01 Jan 2020
https://endoflife.date/python

❯ docker run -it airbyte/bootloader:1.5.0 python --version
Python 2.7.18

Can this be addressed to use a supported version of python?

[vpipkt]

bootloader is a java application, so this component of airbyte (probably) doesn't call this outdated version of python.

In general Airbyte's components that run python use pyenv, see https://github.com/airbytehq/airbyte/blob/master/.python-version and https://github.com/airbytehq/airbyte-platform/blob/main/.python-version

[pvickery-ParamountCommerce]

Ah great! Could python be removed then?

It looks like Python 2.7.18 is coming from amazoncorretto here:

airbyte/airbyte-integrations/bases/base-java/Dockerfile

Lines 9 to 10 in ce53dfa

	ARG JDK_VERSION=17.0.8
	FROM amazoncorretto:${JDK_VERSION}

❯ docker run -it amazoncorretto:17.0.8 python --version
Python 2.7.18

If the tag is updated to use the amazon linux 2023 version, the EOL version of python will be removed. https://docs.aws.amazon.com/linux/al2023/ug/python2.7-no-more.html

❯ docker run -it amazoncorretto:17.0.8-al2023 python --version     
docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "python": executable file not found in $PATH: unknown.

@vpipkt, if this sounds OK I will go ahead and create a PR.

[pvickery-ParamountCommerce]

I've gone ahead and created the PR since it is very small. Hopefully the tests can validate if this old version of python was being used anywhere

[marcosmarxm]

@pvickery-ParamountCommerce what problem are you trying to solve here?

[pvickery-ParamountCommerce]

@marcosmarxm I am reviewing the images used in my cluster to identify any vulnerabilities and EOL software that could be updated or removed. I was using xeol which identified some airbyte containers using the EOL python version. I was hoping that python 2.7 could be removed if it isn't needed 🤞

❯ xeol airbyte/bootloader:1.5.0
 ✔ EOL DB                          [no update available]  
 ✔ Scanned for EOL                 [1 eol matches]  
NAME    VERSION             EOL         DAYS EOL  TYPE 
python  2.7.18-1.amzn2.0.9  2020-01-01  1906      rpm