Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Date Sort & Filter #6

Open
wants to merge 61 commits into
base: main
Choose a base branch
from
Open

Date Sort & Filter #6

wants to merge 61 commits into from

Commits on Jun 27, 2022

  1. initialize with yarn berry

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    98b0b30 View commit details
    Browse the repository at this point in the history

  2. add puppeteer / functions-framework

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    d823a27 View commit details
    Browse the repository at this point in the history

  3. add more dependencies

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    622159e View commit details
    Browse the repository at this point in the history

  4. track large chromium file with git-lfs

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    24ed87b View commit details
    Browse the repository at this point in the history

  5. remove .yarn/unplugged

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    3098ee7 View commit details
    Browse the repository at this point in the history

  6. re-add yarnrc/unplugged as git lfs

    @cmbirk
    cmbirk committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    fca284c View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2022

  1. update lfs, add ts config

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    0688422 View commit details
    Browse the repository at this point in the history

  2. start news scraper

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    e2083e4 View commit details
    Browse the repository at this point in the history

  3. install yarn sdks

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    0ec6a2a View commit details
    Browse the repository at this point in the history

  4. update cache

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    208f7d4 View commit details
    Browse the repository at this point in the history

  5. build first 2 scrapers

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    35c7c14 View commit details
    Browse the repository at this point in the history

  6. add business nc scraper

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    74eb199 View commit details
    Browse the repository at this point in the history

  7. update dependencies

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    a3e040c View commit details
    Browse the repository at this point in the history

  8. tweak business scraper

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    3625f91 View commit details
    Browse the repository at this point in the history

  9. remove git lfs entries

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    d25eaac View commit details
    Browse the repository at this point in the history

  10. remove mac chromium from git

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    07346a0 View commit details
    Browse the repository at this point in the history

  11. remove console statement

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    b42ae2c View commit details
    Browse the repository at this point in the history

  12. finish triangle business journal scraper

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    f434fc7 View commit details
    Browse the repository at this point in the history

  13. build ncPolicyWatch scraper

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    4f290fd View commit details
    Browse the repository at this point in the history

  14. return at end of nc policy watch

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    0752b9d View commit details
    Browse the repository at this point in the history

  15. combine functions

    @cmbirk
    cmbirk committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    7feec62 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2022

  1. update triangle busines journal, carolina journal scrapers

    @cmbirk
    cmbirk committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    b3e117e View commit details
    Browse the repository at this point in the history

  2. add more dependencies

    @cmbirk
    cmbirk committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    4d915bc View commit details
    Browse the repository at this point in the history

  3. type scrapers correctly

    @cmbirk
    cmbirk committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    dbd6bbb View commit details
    Browse the repository at this point in the history

  4. connect scrapers to email sends

    @cmbirk
    cmbirk committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    4168cd0 View commit details
    Browse the repository at this point in the history

  5. attempting to feed all links to transaction send

    @cmbirk
    cmbirk committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    1c0ae90 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2022

  1. finish email testing

    @cmbirk
    cmbirk committed Jul 6, 2022
    Configuration menu
    Copy the full SHA
    d412148 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. add google cloud packages

    @cmbirk
    cmbirk committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    ced1093 View commit details
    Browse the repository at this point in the history

  2. add gcloud secret manager

    @cmbirk
    cmbirk committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    90219d6 View commit details
    Browse the repository at this point in the history

  3. set up function for gcloud deployments and deploy

    @cmbirk
    cmbirk committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    0dd9d10 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. update carolina journal scraper to pull from opinon category instead … 

    …of news
    @cmbirk
    cmbirk committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    f67abe5 View commit details
    Browse the repository at this point in the history

  2. update build for word on the street scrapers

    @cmbirk
    cmbirk committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    fcb8f60 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2022

  1. Merge pull request #1 from CrossroadsCX/feature/scrapers-update 

    Feature/scrapers update
    @cmbirk
    cmbirk authored Aug 8, 2022
    Configuration menu
    Copy the full SHA
    69a3b8d View commit details
    Browse the repository at this point in the history

  2. add workspace-tools yarn plugin

    @cmbirk
    cmbirk committed Aug 8, 2022
    Configuration menu
    Copy the full SHA
    32af482 View commit details
    Browse the repository at this point in the history

  3. plug datastore into sendEmail helper

    @cmbirk
    cmbirk committed Aug 8, 2022
    Configuration menu
    Copy the full SHA
    55d27a9 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2022

  1. Merge pull request #2 from CrossroadsCX/feature/datastore 

    Pull email list from GCP Datastore
    @cmbirk
    cmbirk authored Aug 9, 2022
    Configuration menu
    Copy the full SHA
    48ad09a View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2022

  1. add email utility scripts, add import function to datastore module

    @cmbirk
    cmbirk committed Aug 11, 2022
    Configuration menu
    Copy the full SHA
    cf47b9f View commit details
    Browse the repository at this point in the history

  2. wrap scrapers in try/catch block in case one fails. Return empty arra… 

    …y in that case
    @cmbirk
    cmbirk committed Aug 11, 2022
    Configuration menu
    Copy the full SHA
    6d81d98 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #3 from CrossroadsCX/feature/datastore 

    Datastore / Resiliency
    @cmbirk
    cmbirk authored Aug 11, 2022
    Configuration menu
    Copy the full SHA
    1c3aab2 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2022

  1. add try / catch block around email send, add additional logging

    @cmbirk
    cmbirk committed Aug 13, 2022
    Configuration menu
    Copy the full SHA
    ee3e30c View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. check bcc length and log it

    @cmbirk
    cmbirk committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    5d2061e View commit details
    Browse the repository at this point in the history

  2. remove test email

    @cmbirk
    cmbirk committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    87e6f4a View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. allow errors in sendEmail function

    @cmbirk
    cmbirk committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    db43eef View commit details
    Browse the repository at this point in the history

  2. remove test email

    @cmbirk
    cmbirk committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    7577689 View commit details
    Browse the repository at this point in the history

  3. build functions

    @cmbirk
    cmbirk committed Aug 18, 2022
    Configuration menu
    Copy the full SHA
    35b73a5 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #4 from CrossroadsCX/feature/more-error-checking 

    Feature/more error checking
    @cmbirk
    cmbirk authored Aug 18, 2022
    Configuration menu
    Copy the full SHA
    19a4176 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2022

  1. finish campaign-style api calls for wotd emails

    @cmbirk
    cmbirk committed Aug 20, 2022
    Configuration menu
    Copy the full SHA
    c611f43 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2022

  1. add winston and winston slack transport

    @cmbirk
    cmbirk committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    3876e09 View commit details
    Browse the repository at this point in the history

  2. set correct list id on campaign creation

    @cmbirk
    cmbirk committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    72f10f3 View commit details
    Browse the repository at this point in the history

  3. clean up newsScraper function

    @cmbirk
    cmbirk committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    9410ad5 View commit details
    Browse the repository at this point in the history

  4. build cloud functions

    @cmbirk
    cmbirk committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    e7dfd23 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2022

  1. Merge pull request #5 from CrossroadsCX/feature/create-campaign 

    Create Campaigns
    @cmbirk
    cmbirk authored Aug 24, 2022
    Configuration menu
    Copy the full SHA
    d5215d0 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. update most scrapers, still a couple to finish

    @cmbirk
    cmbirk committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    8c0f19a View commit details
    Browse the repository at this point in the history

  2. update rest of scrapers for date sorting. Still need last 2 days comp… 

    …arisons
    @cmbirk
    cmbirk committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    43933ec View commit details
    Browse the repository at this point in the history

  3. comment unreachable code

    @cmbirk
    cmbirk committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    409a5a6 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. finish date filtering for all scrapers

    @cmbirk
    cmbirk committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    09e9d3b View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. catch errors in date api

    @cmbirk
    cmbirk committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    d33d3fe View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. change node version, update puppeteer

    @cmbirk
    cmbirk committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    4e861f2 View commit details
    Browse the repository at this point in the history

  2. fix newsAndObserver time change

    @cmbirk
    cmbirk committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    9045d2b View commit details
    Browse the repository at this point in the history

  3. add Chromium to lfs

    @cmbirk
    cmbirk committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    c91f9eb View commit details
    Browse the repository at this point in the history

  4. actually add Chromium Framework to git lfs

    @cmbirk
    cmbirk committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    c64586a View commit details
    Browse the repository at this point in the history