Skip to content

4 4 2022 Tech Team Report

Jump to bottom
qqmyers edited this page Apr 4, 2022 · 1 revision

4-4-2022

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
28-Mar-2022 Report, coord re testing 5.10, AnnoRep - cache/recreate title annotation/ann doc, investigate title from pdf, coord re: failures in Curate command, fix merge issue affecting return to author email 3 3
29-Mar-2022 Investigate Curate fails, investigate/start fix for request access popup fail, coord re: annorep on stage 3 2
30-Mar-2022 Coord re: AnnoRep use of return to author, finish requestaccess popup fix, PR, QA, and deployment to dev, stage, test Populate from LDAP on dev, update check_logged_in to exclude more 2 1
31-Mar-2022 Fix Populate from LDAP errors/add logging, run on stage, then prod, investigate/report bad backups on prod 2
1-Apr-2022 Investigate Spring CVE re: AnnoRep, update server code, debug/fix issues with new /titleann, add /titleann handling for pdf, deploy to dev, update wiki, coord re api, fix 409 error on server restart 7

Drupal

  • Updated Populate From LDAP method - typos in email opt-in, handling null for skipped cases, adding completed message
  • Changed check_logged_in to exclude everything except user.login

AnnoRep

  • Created functionality for title ATI annotation for docs, then pdfs
  • Coord re: return-to-author functionality
  • Investigate/fix Spring CVE
  • Debug/fix issues with /titleann and state recovery after restart (AR server store the placeholder title annotation and real ones in the same aux file at dataverse. Upon processing a doc and/or restart, it reads the aux file and generates a separate title annotation and real annotations docs.)
  • Update wiki w.r.t. v 0.0.2 API

Dataverse

  • Investigate/helped fix (hopefully) issue with Curate/Update Current Version failure (appears to be related to ingested files/handling variable-level metadata). PR from @sekmiller at IQSS.
  • Fixed merged typo affecting return to author email
  • Investigated 'partial success' in Curate command. It appears that the transaction boundaries are not as assumed, allowing, for example, the Curate command to update the db but fail to update file DOIs at DataCite and not have a rollback of the db, despite the file DOI updates being in the same command. (Expecting some continuing background discussion/exploration).
  • Investigate/fix request for access popup failure with custom terms. Included refactoring to use common logic with the download popup (which has tests and was fixed prior to release.) The PR from this will be the reason for a v5.10.1 release.

Operations

  • Coordinated re 5.10 test plan
  • Deployed latest Drupal/DV to stage, reapplied robots.txt/language changes for stage test site
  • Coordinated re: AR front-end, updated Hypothesis keys on stage/dev, restarted docker
  • Removed ldap entry for user on prod to allow recreating account
  • Ran updated 'Populate from LDAP' on all machines - added ~320 accounts to prod (people who had registered but then never logged in.)
  • Investigated/reported bad Drupal backups on prod.
  • Deployed updated AR server to dev for testing
    • better title handling in PDF - I think we were sometimes getting the page number as the title before and weren't getting multiline titles
    • bold, italics, and links id docx notes are picked up correctly and put in annotations.
    • docx files with included fonts will render those correctly (not really new)
    • update to fix the Spring CVE out 4/1/22
    • bugs in re-discovering existing converted files after an AR server restart fixed (some of that logic still used the old Dataverse aux file api).

Discussion

  • Backup fix for prod? (do other machines have same mysql issue?)
  • AR Server deploy plans (to push security fix)
  • Heads up re: Dataverse Community meeting call for talks due April 18. (FWIW - StorJ has been asked by IQSS)

Plans

  • AnnoRep - continue to explore/fix docx/pdf github issues
    • Deploy updates to dev/stage/prod
  • Ops
    • Deploy 5.10 to prod when ready
    • Convert prod datasets with custom terms to use QDR license?
  • Dataverse
    • StorJ testing
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
    • QDAS planning/design/prototyping
      • Switch previewer to zipped mimetype
      • Add error handling for format variations
      • Assess whether zip access is enough/project/other files need to be cached as aux files, etc.
    • Still want to investigate the guestbook responses re version info not being included.
  • TBD: FRDR Security
  • Other tasks as discussed in strategic planning
Clone this wiki locally