Merge branch 'master' into reverse-proxy

.coveragerc

@@ -6,7 +6,6 @@ omit =
     */site-packages/nose/*
     *__init__*
     *test/*
-    */luigi/six.py
     */.tox/*
     */setup.py
     */bin/luigidc

.travis.yml

@@ -1,5 +1,5 @@
 language: python
-python: 2.7
+python: 3.7
 dist: xenial
 
 services:
@@ -32,13 +32,6 @@ matrix:
   include:
     - env: TOXENV=flake8
     - env: TOXENV=docs
-    - env: TOXENV=py27-core
-    - env: TOXENV=py27-dropbox
-      if: env(DROPBOX_APP_TOKEN) is present
-    - env: TOXENV=py27-unixsocket
-    - env: TOXENV=py27-apache
-    - env: TOXENV=py27-aws
-    - env: TOXENV=py27-postgres
 
     - python: 3.6
       env: TOXENV=py36-core
@@ -47,6 +40,12 @@ matrix:
       if: env(DROPBOX_APP_TOKEN) is present
     - python: 3.6
       env: TOXENV=py36-unixsocket
+    - python: 3.6
+      env: TOXENV=py36-postgres
+    - python: 3.6
+      dist: xenial
+      sudo: true
+      env: TOXENV=py36-apache
 
     - python: 3.7
       dist: xenial
@@ -73,6 +72,8 @@ matrix:
       dist: xenial
       sudo: true
       env: TOXENV=py37-azureblob
+    - python: 3.7
+      env: TOXENV=py37-postgres
 
 cache:
   directories:
@@ -99,6 +100,7 @@ script:
 branches:
   only:
     - master
+    - py2-deprecation
 
 notifications:
   email: false

CONTRIBUTING.rst

@@ -8,6 +8,7 @@ participating, you are expected to honor this code.
 Running the tests
 -----------------
 
+
 We are always happy to receive Pull Requests. When you open a PR, it will
 automatically build on Travis. So you're not strictly required to test the
 patch locally before submitting it.
@@ -22,10 +23,10 @@ You will need a ``tox --version`` of at least 2.0.
     # These commands are pretty fast and will tell if you've
     # broken something major:
     tox -e flake8
-    tox -e py27-core
+    tox -e py37-core
 
     # You can also test particular files for even faster iterations
-    tox -e py27-core test/rpc_test.py
+    tox -e py37-core test/rpc_test.py
 
     # The visualiser tests require phantomjs to be installed on your path
     tox -e visualiser
@@ -34,7 +35,7 @@ You will need a ``tox --version`` of at least 2.0.
     tox -e py33-cdh
     tox -e py34-hdp
 
-Where ``flake8`` is the lint checking, ``py27`` is obviously Python 2.7.
+Where ``flake8`` is the lint checking, ``py37`` is obviously Python 3.7.
 ``core`` are tests that do not require external components and ``cdh`` and
 ``hdp`` are two different hadoop distributions. For most local development it's
 usually enough to run the lint checking and a python version for ``core``

README.rst

@@ -17,7 +17,7 @@
 .. image:: https://img.shields.io/pypi/l/luigi.svg?style=flat
    :target: https://pypi.python.org/pypi/luigi
 
-Luigi is a Python (2.7, 3.6, 3.7 tested) package that helps you build complex
+Luigi is a Python (3.6, 3.7 tested) package that helps you build complex
 pipelines of batch jobs. It handles dependency resolution, workflow management,
 visualization, handling failures, command line integration, and much more.
 
@@ -134,7 +134,6 @@ or held presentations about Luigi:
 * `Foursquare <https://foursquare.com/>`_ `(presentation, 2013) <http://www.slideshare.net/OpenAnayticsMeetup/luigi-presentation-17-23199897>`__
 * `Mortar Data (Datadog) <https://www.datadoghq.com/>`_ `(documentation / tutorial) <http://help.mortardata.com/technologies/luigi>`__
 * `Stripe <https://stripe.com/>`_ `(presentation, 2014) <http://www.slideshare.net/PyData/python-as-part-of-a-production-machine-learning-stack-by-michael-manapat-pydata-sv-2014>`__
-* `Asana <https://asana.com/>`_ `(blog, 2014) <https://eng.asana.com/2014/11/stable-accessible-data-infrastructure-startup/>`__
 * `Buffer <https://buffer.com/>`_ `(blog, 2014) <https://overflow.bufferapp.com/2014/10/31/buffers-new-data-architecture/>`__
 * `SeatGeek <https://seatgeek.com/>`_ `(blog, 2015) <http://chairnerd.seatgeek.com/building-out-the-seatgeek-data-pipeline/>`__
 * `Treasure Data <https://www.treasuredata.com/>`_ `(blog, 2015) <http://blog.treasuredata.com/blog/2015/02/25/managing-the-data-pipeline-with-git-luigi/>`__
@@ -156,6 +155,7 @@ or held presentations about Luigi:
 * `Uppsala University <http://pharmb.io>`_ `(tutorial) <http://uppnex.se/twiki/do/view/Courses/EinfraMPS2015/Luigi.html>`_   / `(presentation, 2015) <https://www.youtube.com/watch?v=f26PqSXZdWM>`_ / `(slides, 2015) <https://www.slideshare.net/SamuelLampa/building-workflows-with-spotifys-luigi>`_ / `(poster, 2015) <https://pharmb.io/poster/2015-sciluigi/>`_ / `(paper, 2016) <https://doi.org/10.1186/s13321-016-0179-6>`_ / `(project) <https://github.com/pharmbio/sciluigi>`_
 * `GIPHY <https://giphy.com/>`_ `(blog, 2019) <https://engineering.giphy.com/luigi-the-10x-plumber-containerizing-scaling-luigi-in-kubernetes/>`__
 * `xtream <https://xtreamers.io/>`__ `(blog, 2019) <https://towardsdatascience.com/lessons-from-a-real-machine-learning-project-part-1-from-jupyter-to-luigi-bdfd0b050ca5>`__
+* `CIAN <https://cian.ru/>`__ `(presentation, 2019) <https://www.highload.ru/moscow/2019/abstracts/6030>`__
 
 Some more companies are using Luigi but haven't had a chance yet to write about it:
 
@@ -186,6 +186,8 @@ Some more companies are using Luigi but haven't had a chance yet to write about
 * `xtream <https://www.xtreamers.io/>`__
 * `Skyscanner <https://www.skyscanner.net/>`_
 * `Jodel <https://www.jodel.com/>`_
+* `Mekar <https://mekar.id/en/>`_
+* `M3 <https://corporate.m3.com/en/>`_
 
 We're more than happy to have your company added here. Just send a PR on GitHub.
 

RELEASE-PROCESS.rst

@@ -2,7 +2,7 @@ For maintainers of Luigi, who have push access to pypi. Here's how you upload
 Luigi to pypi.
 
 #. Make sure [twine](https://pypi.org/project/twine/) is installed ``pip install twine``.
-#. Update version number in `setup.py`.
+#. Update version number in `luigi/__meta__.py`.
 #. Commit, perhaps simply with a commit message like ``Version x.y.z``.
 #. Push to GitHub at [spotify/luigi](https://github.com/spotify/luigi).
 #. Clean up previous distributions by executing ``rm -rf dist``