Skip to content
This repository has been archived by the owner on Mar 3, 2023. It is now read-only.

Python 3 upgrade #3522

Merged
merged 26 commits into from
Jul 7, 2020
Merged

Python 3 upgrade #3522

merged 26 commits into from
Jul 7, 2020

Commits on May 3, 2020

  1. Initial Python 3 upgrade effort

    Neng Lu authored and Code0x58 committed May 3, 2020
    Configuration menu
    Copy the full SHA
    c54ebda View commit details
    Browse the repository at this point in the history

Commits on May 4, 2020

  1. Fixes towards python3 support

     * update heronpy release scripts for python3
     * update dist Dockerfiles to only use python3
     * remove python2 from docker images
     * upgrade pylint for python3 support
     * upgrade PEX so transative dependencies are captured
    
    Additionally:
     * fix Ubuntu 16.04 images
     * fix linting issues found by newer pylint
    
    There is an issue with encapsulation in the builds where the global python3 environment is used
    while PEX installs a nested transitive dependency of pylint: `pylint>astroid>wrapt`. This seems
    to be because of logic in its setup.py which can be disabled with `WRAPT_INSTALL_EXTENSIONS=false`
    Code0x58 committed May 4, 2020
    Configuration menu
    Copy the full SHA
    5eecc70 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2020

  1. Fix new pylint issues

    Code0x58 committed May 5, 2020
    Configuration menu
    Copy the full SHA
    33d29d2 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2020

  1. update setuptools

    Code0x58 committed May 9, 2020
    Configuration menu
    Copy the full SHA
    b3bb9d2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    38d0b95 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2020

  1. Rough proto_library fix

    The issue encountered was protocolbuffers/protobuf#1491 which
    may be fixed by a pending PR to protoc, or with a switch to the official protobuf rules
    and the import_prefix parameter to proto_library.
    Code0x58 committed May 18, 2020
    Configuration menu
    Copy the full SHA
    6edf005 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2020

  1. WIP: Fix python3 incompatibilities

     * bytes vs str issues
     * update kazoo
     * order of processes in executor test changed due to dict ordering?
     * some places needed / switched to // - may be more not caught by tests
     * add travis_wait as some stages going over 10 minutes without output in CI
    
    TODO:
     * make sure the kazoo upgrade is correct, it was done only by updating package versoin
    Code0x58 committed May 19, 2020
    Configuration menu
    Copy the full SHA
    3a61cb1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e0d36c2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7244532 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2020

  1. Upgrade docker rules

    Code0x58 committed May 21, 2020
    Configuration menu
    Copy the full SHA
    ae49c65 View commit details
    Browse the repository at this point in the history
  2. Upgrade to python3 in CI

    Code0x58 committed May 21, 2020
    Configuration menu
    Copy the full SHA
    2641d1b View commit details
    Browse the repository at this point in the history

Commits on May 22, 2020

  1. Fix python integration tests

    Code0x58 committed May 22, 2020
    Configuration menu
    Copy the full SHA
    f613145 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2020

  1. Configuration menu
    Copy the full SHA
    20b19ce View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e8cab36 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2020

  1. Configuration menu
    Copy the full SHA
    61df76d View commit details
    Browse the repository at this point in the history

Commits on May 28, 2020

  1. Reduce requirement to python3.6 + py3 fixes

     * use universal_newline in popen instead of text in Popen for py3.6
     * fix bytes/str issues in deserialisation
     * fix file open modes
     * use set instead of sets.Set
     * fix __import__(level) default
    Code0x58 committed May 28, 2020
    Configuration menu
    Copy the full SHA
    52f672d View commit details
    Browse the repository at this point in the history
  2. Update cloudpickle

    Code0x58 committed May 28, 2020
    Configuration menu
    Copy the full SHA
    1f80d5a View commit details
    Browse the repository at this point in the history

Commits on May 30, 2020

  1. Configuration menu
    Copy the full SHA
    cd7cfc6 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2020

  1. Configuration menu
    Copy the full SHA
    5efa344 View commit details
    Browse the repository at this point in the history
  2. Additions to get docker image builds working and tested

     * use new external pkg_* rules
     * add python to compile docker images until pkg_*
     * add --host_force_python=PY3 to other bazel.rc files
    Code0x58 committed May 31, 2020
    Configuration menu
    Copy the full SHA
    6eeb7d2 View commit details
    Browse the repository at this point in the history
  3. WIP: Add CI for docker images/releases

     * use kind to create ephemeral clusters
     * start consolidating scripts with python
    Code0x58 committed May 31, 2020
    Configuration menu
    Copy the full SHA
    9c855d7 View commit details
    Browse the repository at this point in the history
  4. Fix helm chart

    Code0x58 committed May 31, 2020
    Configuration menu
    Copy the full SHA
    8cad777 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2020

  1. bytes vs str fix

    Code0x58 committed Jun 6, 2020
    Configuration menu
    Copy the full SHA
    ede1437 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2020

  1. Configuration menu
    Copy the full SHA
    1d27bfc View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2020

  1. Configuration menu
    Copy the full SHA
    525aedf View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2020

  1. updatedockerfile

    huijunwu committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    d280a75 View commit details
    Browse the repository at this point in the history