Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Funders TOC" in RacialEquity2030 needs to update if live funder data changes. #108

Open
kfogel opened this issue Apr 30, 2021 · 1 comment
Assignees
Labels

Comments

@kfogel
Copy link
Member

kfogel commented Apr 30, 2021

If one were to edit the funders in RacialEquity2030, the Funders TOC currently wouldn't update, as it's generated at ETL time from the original ETL data.

Thus there are two degrees of possible fix:

  1. When regenerating the TOC in a (presumably manually initiated) ETL process, pull data from the running system.
  2. Just generate the TOC from live data at page-load time (or if it takes a long time, then generate it periodically and cache the result?). I don't know how hard this second option would be; I'm just pointing out that it exists and -- from an up-to-dateness point of view -- is better than the ETL-time option.
@frankduncan
Copy link
Collaborator

frankduncan commented Apr 30, 2021

Some information on option 2. Torque is currently designed to be data agnostic, so it means we would need to either put the grouping logic into jinja, or create a way to have torque passed code that it runs the data through (through specification or code). I'm guessing it would be better to explore one of those options rather than do it in the etl pipeline, from a user experience point of view.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants