Skip to content

9 16 2024 Tech Team Report

Jump to bottom
qqmyers edited this page Sep 16, 2024 · 1 revision

9-16-2024

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
9-Sep-2024 Reporting, meeting, Drupal 10.3.3, stitemap module updates to dev/stage, update tests for DataCite PR, review doc, add release note, try running PID updates on dev, start debugging failures 4
10-Sep-2024 Coord re file access api, investigate/fix blocked tester IP, investigate/fix failures in attempting to update all DOIs at DataCite, add to PR, document APIs, change to POST, fix bug in old api, verify results on dev. 5
11-Sep-2024 Coord re: refresh for datasets in review, update 6.3-qdr branch w/ DataCiIte fixes, deploy to stage, coord re: depoy to prod, deploy ORCID/ROR a11y fixes to prod, update Drupal to 10.3.4 (sec fix) to dev/stage, check that dependabot alert closed, update DataCite PR test 3
12-Sep-2024 Coord re: DVUploader, deploy 6.3 updates to prod, change grantNumberAgency field to use ROR instead of FundReg on dev/stage, add ROR parsing for this field in the DataCiteXML generation, deploy to dev/stage and test, coord. Re: prod deployment, coord re LC discussion, update DataCite xml PR with latest changes, backward incompatibility note 4
13-Sep-2024 Deploy Drupal 10.3.5 to dev/stage, run DOI md update on prod/monitor/fix issues w.r.t. missing required fields/add to PR, coord, fix missing last name not being added to Drupal account, investigate why it isn't in LDAP, explore login to DV using social with MFA enabled, create custom keycloak plugin to add acr/acr_level from Drupal, investigate login error from IDP for passive login with social account 7
14-Sep-2024 Analyze logs for md fails, fix additional issues in DataCite xml, deploy to dev, stage, add to PR, investigate/fix DV on dev (wrong branch deployed) 2

Operations

  • Coord re use of file access, DVUploader
  • Investigate/fix blocked tester IP - coordinated to identify reason for initial block - keeping pages for datasets in review open - they request an update every 10 seconds which can look like abuse
  • Deployed updated ORCID/ROR capabilities to prod, changed to use ROR for Funder/GrantNumberAgency
  • Deployed updated v6.3-qdr to prod with initial DataCite XML/API fixes
  • Ran/monitored/reported on DataCite metadata updates on prod. Initial result: ~25 datasets have one of ~4 problems, such as not including a contributor type (which is required by the DataCite schema) or specifying a related publication as having an identifier type of doi w/o having any number/url filled in, that caused failures. Provided Sebastian with a detailed per dataset report. Updates have been made in Dataverse that will allow these to be processed now.

SSO

  • Fixed issue with missing name not showing in Drupal account after being added in social login reg form response. Investigating why it is still not getting to LDAP
  • Explore issue with MFA access levels causing failure of Dataverse passive login for social accounts. (Strangely, the auth call to Keycloak appears to be exactly the same for social/local login but local works.) Not yet resolved.
  • Created custom Keycloak OIDC Drupal plugin to allow sending access level requests from Drupal (i.e. to allow choosing MFA/level 2)
  • Explored options for requiring terms to be accepted before Dataverse login - planning to set(Drupal)/check(Dataverse) a cookie indicating whether terms have been accepted and redirect if needed.

Drupal

  • Updates to 10.3.3, 10.3.4, 10.3.5, sitemap module on dev/stage

Dataverse

  • Updated tests in the DataCite xml + relationType PR, added release note, added bug fixes from dev and prod results, updated /modify* PID update methods, added documentation, switched to use POST for calls that change state, added ROR parsing in GrantNumberAgency field so it will be sent to DataCite

HEAL

TKLabels

  • Current plan for GDCC work is to add the a11y fixes from ORCID/ROR to the LocalContexts script, await LC changes that would allow trying to discover projects via dataset DOI. Anyone who wants to can create accounts at sandbox.localcontextshub.org for testing.

AnnoRep

Discussion

  • Drupal deploy was fixed - what was changed?
  • Prod DataCite XML updates - should I deploy the code fixes and run again or wait for additional md changes/ what are next steps?

Plans

  • Fix Google login issue when last name isn't provided
  • Get MFA to a usable state w.r.t. on authentication issue #43(MFA, etc.)
  • Shephard relationship type entry in metadata block #44 (more metadata to DataCite, etc.) through testing/review/QA
  • Work towards v6.4-qdr release
  • Background work to change/remove deprecated Drupal modules in prep for 11.0.0
  • Fix Stata-14 ingest by allowing file inspection during direct upload or adjusting the Stata ingester.
  • Fix #113 if possible
  • Matomo - investigate event-level tracking via tag manager, remove non-working google scripts
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for guestbook adding datasetversion fix
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security
Clone this wiki locally