Skip to content

10 30 2023 Tech Team Report

Jump to bottom
qqmyers edited this page Oct 30, 2023 · 1 revision

10-30-2023

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
23-Oct-2023 Reporting, update prod qdr-keycloak deployment, edit ldap, orcid, google, etc. to change from stage to prod urls and creds, add new DV jvm options, del flyway entry 58, add D8 mysql entries needed to bootstrap, create new google creds, add S. Karcher as owner in QDR-OIDC project, stage ldap scripts on prod, coord, comment-out shib-related apache2 settings, shutdown shibd, shib-idp(jetty) on dev/stage, remove autostart on dev, update token module&coder cl tool on dev/stage, run d10 analysis on dev 6
24-Oct-2023 Work through prod upgrades, investigate/fix affiliation/role switch, reindex, merge gb branch into dev, investigate changes to user edit form, other reported issues 7
25-Oct-2023 Check reindex, run orphan api call, start reexport, investigate/fix issue with no datavar freq. (2 in prod db), Drupal - remove old shib code, remove change password functionality (now in Keycloak), deploy/test on dev, change Dataverse edit account menu to match, work through D10 updates and fixes for modules, clear diskspace on dev 5
26-Oct-2023 Fix remaining modules, use standard nodeaccess, try D10 install, fix qdr_oidc_sso issues, fix drush path issue, run db updates, investigate deploy failures, fix qdr_reg deprecation, investigate activity_tracker module status, change db setting to READ-COMMITTED, add samesite=Strict in php.ini and restart apache 6
27-Oct-2023 Update stage db to READ-COMMITTED, create rich HTML previewer for QDR, adjust styling to display journal webpage html properly, start refactor to use signed URLs in previewers. 5
28-Oct-2023 Finish signedUrls for previewers, note potential issue with privateUrls 2

Operations

  • Prepared for prod upgrade on 10/25
    • Update prod qdr-keycloak deployment, edit ORCID, Google, etc. to use production URLs and creds (was set for stage)
    • Add new jvm options for 5.14, delete obsolete flyway entry
    • Add mysql entries to allow login after updating Drupal deployment and before OIDC is configured
    • Add Sebastian as owner in Google Cloud QDR-OIDC project (which has our Google OIDC creds)
    • Stage ldap scripts on prod
    • Shutdown shibd, jetty (shib-idp) on dev/stage, remove autostart on dev
  • Upgrade prod
    • Fix issues discovered (see Drupal/Dataverse sections)
    • Reindex, run Solr orphan remover api, re-export (issue found with re-export -see Dataverse section)
  • Post upgrade
    • Removed downtime notice
    • Coordinated re: getting real (non-sandbox) ORCID creds for prod

Drupal

  • Update token module and coder cl tool in dev/stage
  • Remove password reset logic from Drupal edit profile page (as this is done in Keycloak now)
  • Update to Drupal 10
    • Upgrade ~6 modules,
    • Add patches or custom modules for others that weren't compatible,
    • Fix incompatibilities in QDR theme,
    • Fix issues in qdr_registration, qdr_menu, qdr_helpful_resources, qdr_oidc_sso modules,
    • Investigate/work-around drush issue with symbolic link
    • Investigate activity-tracker module status (internal one is deprecated but still OK in D10, contributed one needs to have a PR merged before it is D10 ready, so keeping deprecated module for now. Could use a custom version of the contributed one if/when needed).
    • Set db to READ-COMMITTED as recommended on dev/stage
    • Reconfigured to load webform javascripts locally instead of from CDN
    • Added samesite= Strict in php.ini and restart apache2

Dataverse

  • Merge guestbook-at-request branches back into standard develop/v5.14 branches
  • Investigate/fix re-export issue with DDI export failing on missing category variable frequency (which is optional - we have two such instances)
  • Investigate/fix issue where affiliation and role are reverse in Dataverse profile for new OIDC accounts
  • Change Dataverse MyData/Account Info menus to match current functionality
  • Created Rich HTML previewer for QDR, adjusted styling/dropped Bootstrap, adjusted width handing to avoid interaction with PJP Journal web page styling
  • Updated all standard previewers to use signed URLs

AnnoRep

Discussion

  • Cleanup - remove autostart of shibd, jetty, remove code from machines and github?
  • Fix for Drupal install - drush problem with symbolic link
  • Deploy bug fixes to prod (fixes to MyData/Account are OK?)?
  • Then test/deploy Drupal 10?
  • Update prod Previewers?

Plans

  • Deploy Drupal 10 upgrade to stage/prod
  • Check privateURLs with signedURL previewers
  • Deploy rich HTML previewer/new signedUrl previewers
  • Fix Stata-14 ingest by allowing file inspection during direct upload or adjusting the Stata ingester.
  • Fix #113 if possible
  • Matomo - investigate event-level tracking via tag manager, remove non-working google scripts
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for guestbook adding datasetversion fix
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security
Clone this wiki locally