Merge pull request #426 from lsst/tickets/DM-41711

DM-41711: Upgrade QuantumGraphExecutionReport to handle multiple overlapping graphs
lsst · Sep 23, 2024 · c8ee65f · c8ee65f
2 parents a82cb14 + e5d3d75
commit c8ee65f
Show file tree

Hide file tree

Showing 3 changed files with 1,313 additions and 0 deletions.
diff --git a/doc/changes/DM-41711.feature.md b/doc/changes/DM-41711.feature.md
@@ -0,0 +1,11 @@
+Create a QuantumProvenanceGraph, which details the status of every quantum
+and dataset over multiple attempts at executing graphs, noting when quanta
+have been recovered.
+
+Step through all the quantum graphs associated with certain tasks or
+processing steps. For each graph/attempt, the status of each quantum and
+dataset is recorded in `QuantumProvenanceGraph.add_new_graph` and outcomes
+of quanta over multiple runs are resolved in
+`QuantumProvenanceGraph.resolve_duplicates`. At the end of this process,
+we can combine all attempts into a summary. This serves to answer the
+question "What happened to this data ID?" in a wholistic sense.