Skip to content

7 25 2022 Tech Team Report

qqmyers edited this page Jul 25, 2022 · 1 revision

7-25-2022

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
18-Jul-2022 Report, meeting, add tests for apache bug, update dev branch w/o unzip for future dev, start adding javascript unzip to qdas previewer 2 3
19-Jul-2022 Improve Drupal teaser robustness, update metatag and autologout modules, deploy to dev/stage, update v5.11-qdr branch, deploy to stage, investigate AnnoRep failure/fix client config for server IP & restart, document in issue#7 3 1
20-Jul-2022 Update draft and latest released versions to have fileaccessrequest==true, investigate/deploy Drupal core sec update to dev/stage 2
21-Jul-2022 Continue javascript unzip for qdas, merge/update DV dev branch to get HTTP Range fixes needed for QDAS + merge citation block text changes, archival status api 3 2
22-Jul-2022 More qdas script changes, get zip and project file versions working, add progress info, add graph reset, investigate zoom. 6

Operations

  • Investigated/fixed annorep client misconfig on prod - related to server ip change when backup testing, so documented in issue #7
  • Investigated issue w.r.t. dataset update failures - due to no terms of access or filerequestaccess==true. Found/fixed all existing draft/last published versions of datasets on prod (and stage as a test) via db changes
  • Drupal and DV updated on dev/stage for testing prior to prod deployment

Drupal

  • Updated metatag, autologout modules
  • Updated Drupal Core
  • Improved teaser robustness - Drupal should still work/show homepage now if Dataverse is down or other error with getting image/title/description for teaser paragraphs occurs

Dataverse

  • Updated v5.11 -qdr branch with recent fixes
  • Created branch with server-side unzip for future reference (won't be used for now but code is potentially useful)
  • Updated dev branch with latest from IQSS to pick up changes needed for client-side/Javascript unzip via ranged requests. The update also included a messy merge for changes in the description of many metadata terms (see #8708), and changes to the archival status api/display (still need to test).

QDAS

  • Updated QDAS previewers to use client-side retrieval of files in zip.
  • Now handle missing 'Sources' section, added simple progress indicator, added reset button for graph section

Discussion

  • Would like to try lower autovacuum threshold on guestbookresponse table to hopefully limit inaccuracy in download count. This is reversible (i.e. you can remove it) and autovacuum/analyze should not be doing anything to the entries (it may reshuffle things on disk and updates query planning stats). This is something where we could/should report results back to the community.
  • QDAS Previewer - next priorities? W.r.t. edit - would writing a lower-sensitivity version of the project file as an auxiliary object make sense (as the Open Differential Privacy project does?)

Plans

  • AnnoRep - continue to explore/fix docx/pdf github issues
    • Deploy updates to dev/stage/prod
  • Dataverse
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
    • Still want to investigate the guestbook responses re version info not being included.
  • QDAS Previewer
    • Updates per request/Investigate writing aux file/previewing lower-sensitivity version
  • TBD: FRDR Security
  • Other tasks as discussed in strategic planning
Clone this wiki locally