Skip to content
This repository has been archived by the owner on May 1, 2024. It is now read-only.

WIP-Spark Tasks #476

Open
wants to merge 14 commits into
base: master
Choose a base branch
from
Open

WIP-Spark Tasks #476

wants to merge 14 commits into from

Commits on May 25, 2018

  1. convert TotalEventsDailyTask task to spark #486

    @rao-abdul-mannan
    rao-abdul-mannan committed May 25, 2018
    Configuration menu
    Copy the full SHA
    097b826 View commit details
    Browse the repository at this point in the history

  2. convert user activity task to spark

    @rao-abdul-mannan
    rao-abdul-mannan committed May 25, 2018
    Configuration menu
    Copy the full SHA
    d615749 View commit details
    Browse the repository at this point in the history

  3. move spark runtime options to luigi config

    @rao-abdul-mannan
    rao-abdul-mannan committed May 25, 2018
    Configuration menu
    Copy the full SHA
    d06f87f View commit details
    Browse the repository at this point in the history

  4. replace username with user_id

    @rao-abdul-mannan
    rao-abdul-mannan committed May 25, 2018
    Configuration menu
    Copy the full SHA
    78a842f View commit details
    Browse the repository at this point in the history

  5. rebased with master before location history job conversion

    @rao-abdul-mannan
    rao-abdul-mannan committed May 25, 2018
    Configuration menu
    Copy the full SHA
    0b8b937 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2018

  1. user location history spark task

    @rao-abdul-mannan
    rao-abdul-mannan committed May 31, 2018
    Configuration menu
    Copy the full SHA
    01f6b2b View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2018

  1. using manifest file as input source to spark

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 7, 2018
    Configuration menu
    Copy the full SHA
    b863f58 View commit details
    Browse the repository at this point in the history

  2. Enable logging in spark tasks

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 7, 2018
    Configuration menu
    Copy the full SHA
    744684e View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2018

  1. Process event logs directly

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 8, 2018
    Configuration menu
    Copy the full SHA
    e204e49 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2018

  1. using wildcards with dataframe source

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 10, 2018
    Configuration menu
    Copy the full SHA
    2b7b94b View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2018

  1. with rdd

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 13, 2018
    Configuration menu
    Copy the full SHA
    64308be View commit details
    Browse the repository at this point in the history

  2. enable verbose logging

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 13, 2018
    Configuration menu
    Copy the full SHA
    1a42858 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2018

  1. address PR review changes

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 14, 2018
    Configuration menu
    Copy the full SHA
    5f6726d View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2018

  1. Parallelize file loading to reduce in-activity delays

    @rao-abdul-mannan
    rao-abdul-mannan committed Jun 20, 2018
    Configuration menu
    Copy the full SHA
    e5d3e87 View commit details
    Browse the repository at this point in the history