2024 - Q1

April 15, 2024

This release includes a new feature we've been developing for the last six months or so - User Defined Forms (UDF). HAWC has always had a fixed schema for data extraction; this was an intentional decision because we wanted to be able to visualize content and perform standardized data analysis across assessments. However, it came at the expense of flexibility. Adding UDFs will allow users to augment existing forms with custom fields for their assessment. Right now, we've added UDFs to literature tags, studies, and bioassay endpoints, but we expect to add more UDF options to other items in the future. We plan on adding UDF data exports and integration with existing visuals in the next release. Documentation is limited, but please reach out with any questions or comments - we'd love to hear your feedback!

Other notable updates include new options in Data Pivot visualizations (calculated columns, columns to the right of the plot), updated task table filtering, updated assessment analytics for epidemiology and study evaluation domains, and many minor user-interface improvements throughout HAWC based on user feedback.

A total of 42 pull requests were merged into HAWC from 2024-02-02 to 2024-04-15. The complete changelog is described in summary below; see the emoji legend which describes how changes are categorized:

Global Changes:

• 🚀 Rework task table and added more sorting options by @shapiromatron in #1000
• 🚀 Added task export by @shapiromatron in #999
• 🚀 Improve User Defined Form (UDF) creation + binding workflows views by @caseyhans in #989
• 🚀 Improve icon representing boolean by @caseyhans in #974
• 🚀 Display HTMX errors that were previously silent by @munnsmunns in #978
• 🚀 Add automated scrolling in HTMX forms by @caseyhans in #990
• 🐞 Improve recording of time spent by @shapiromatron in #996 #1007

Assessment:

• 🚀 Expand assessment analytics with epi and study evaluation data by @dannypeterson in #1010
• 🚀 Expand options for assessment details by @shapiromatron in #998
• 🐞 Fix assessment duplicates in search by @caseyhans in #1001
• 🐞 Fix label for assessment downloads by @shapiromatron in #973

Literature Screening and Tagging:

• 🚀 Added UDF to reference tagging by @munnsmunns in #913
• 🐞 Fix candidate tag filtering by @caseyhans in #977
• 🐞 Fix "needs further tagging" after consensus tags applied by @caseyhans in #1009

Data Extraction:

• 🚀 Added UDF to study forms and views by @munnsmunns in #906
• 🚀 Added UDF to bioassay endpoint forms and views by @munnsmunns in #906
• 🚀 Added "unpublished" parameter to animal client by @dannypeterson in #1011
• 🧪 Build initial data schema for animal v2 data extractions by @DookTibs in #947

Visualizations:

• Data Pivot:
  • 🚀 Add calculated columns by @rabstejnek in #991
  • 🚀 Add columns to the right of the figure by @shapiromatron in #987
  • 🚀 Improve logscale domain estimate by @shapiromatron in #1002
  • 🚀 Added additional fields to data pivot list API by @shapiromatron in #1005
  • 🐞 Fix conditional formatting for discrete numeric values by @shapiromatron in #993
• Exploratory Heatmap:
  • 🚀 Preview custom filter logic @rabstejnek in #986
  • 🚀 Improve performance of data preview by @rabstejnek in #979
• Static image:
  • 🚀 Added max width and alt-text image options by @shapiromatron in #1008

Developer/Security updates:

• 🔒 Add turnstile to unauthenticated user views by @shapiromatron in #1004
• 🔒 Add email verification checks for user accounts @shapiromatron in #1004
• 🔒 Disable deletion of some content in the admin by @shapiromatron in #981
• 🛠️ Add HTML template formatting @munnsmunns in #985
• 🛠️ Replace bleach with nh3 by @dannypeterson in #984
• 🛠️ Improve test coverage by @shapiromatron in #969
• 🛠️ Improve client visual downloader by @munnsmunns in #988
• 🛠️ Remove patch after proper fix upstream @munnsmunns in #975
• 🛠️ Replace pytest-vcr with pytest-recording by @dannypeterson in #994
• 🛠️ HTMX ViewSet URL updates by @rabstejnek in #992
• 🛠️ Remove create DTXSID by api by @dannypeterson in #995
• 🐞 Fix regression in choice fields by @shapiromatron in #983
• 🐞 Fix bug when returning Study IDs by @shapiromatron in #1006
• 🐞 Add ID check validator helper method @shapiromatron in #1003
• 🐞 Restrict EHV tag API to accept only integer for detail ID by @shapiromatron in #997

Emoji legend:

• 🚀 Feature - this is a new feature or improvement to the existing application
• 🧪 In Progress - a feature actively under development; may not yet be available in production
• 🐞 Bug - fixed an error in the current software
• 📄 Documentation - updated user/developer documentation
• 🔒 Security Updates - security related updates
• 🛠️ Developer Tools - updated internal tooling for a better developer experience