Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ARXIVCD-608] missing file to log in JSON #392

Merged
merged 22 commits into from
Oct 4, 2023
Merged

[ARXIVCD-608] missing file to log in JSON #392

merged 22 commits into from
Oct 4, 2023

Commits on Sep 20, 2023

  1. Add digester and profiler.

    @ntai-arxiv
    ntai-arxiv committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    85d0a2b View commit details
    Browse the repository at this point in the history

  2. quality of life improvement.

    @ntai-arxiv
    ntai-arxiv committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    d823eaf View commit details
    Browse the repository at this point in the history

  3. Digest making is too slow. Try mtime.

    @ntai-arxiv
    ntai-arxiv committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    5ea16a9 View commit details
    Browse the repository at this point in the history

  4. Add some default ignores. Get ready for bigger dir.

    @ntai-arxiv
    ntai-arxiv committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    932b013 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Implement the skip list.

    @ntai-arxiv
    ntai-arxiv committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    33eaa32 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. JSON logging added. Simple logging test added.

    @ntai-arxiv
    ntai-arxiv committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    b58ccea View commit details
    Browse the repository at this point in the history

  2. Add test target.

    @ntai-arxiv
    ntai-arxiv committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    f79278a View commit details
    Browse the repository at this point in the history

  3. Not uesd yet.

    @ntai-arxiv
    ntai-arxiv committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    0335986 View commit details
    Browse the repository at this point in the history

  4. Forgot to include a digester.

    @ntai-arxiv
    ntai-arxiv committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    565d21c View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Test the JSON log output a little bit better.

    @ntai-arxiv
    ntai-arxiv committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    2e15ed3 View commit details
    Browse the repository at this point in the history

  2. Fix the make to set up the venv. Add testing option to sync_published.sh

    @ntai-arxiv
    ntai-arxiv committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    8fb0e9f View commit details
    Browse the repository at this point in the history

  3. Add tesing option to do a dry-run

    @ntai-arxiv
    ntai-arxiv committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    e774955 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. 1. The upload error now shows as warning in the log 

    2. Stanza's plugin file for the sync2gcp added.
3. The test takes a look at the log output more carefully.
    @ntai-arxiv
    ntai-arxiv committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    be4133a View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2023

  1. Uploading to GS - Success and failed cases.

    @ntai-arxiv
    ntai-arxiv committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    70dd35c View commit details
    Browse the repository at this point in the history

  2. Update the README.md

    @ntai-arxiv
    ntai-arxiv committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    223d090 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. minor adjustments for the reality check

    @ntai-arxiv
    ntai-arxiv committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a1f5d9d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Fixing up nits.

    @ntai-arxiv
    ntai-arxiv committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    78faca6 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/ntai/arxivce-608-missing-file' i… 

    …nto ntai/arxivce-608-missing-file
    @ntai-arxiv
    ntai-arxiv committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    6aa5de7 View commit details
    Browse the repository at this point in the history

  3. Separating out the text logging so that the cron job can run from non… 

    …-log directory.
    @ntai-arxiv
    ntai-arxiv committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    326b783 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Adjust some logging message and JSON log level.

    @ntai-arxiv
    ntai-arxiv committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    eac5784 View commit details
    Browse the repository at this point in the history

  2. Fix up the tests, and logging.

    @ntai-arxiv
    ntai-arxiv committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    5b97ceb View commit details
    Browse the repository at this point in the history

  3. Append stdout/stderr, not overwrite

    @ntai-arxiv
    ntai-arxiv committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    5b8818e View commit details
    Browse the repository at this point in the history