You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
This issue to disqualify jobs if the eventlogs are from Databricks photon. Currently, eventlogs are read and the Photon Execs are marked as unsupported since the Exec names are different from regular CPU Execs. Ex: PhotonBroadcastExchange -> BroadcastExchange.
We need to mark the job as Not Applicable if the eventlogs are from Photon runs until we add support for Photon eventlogs.
Issue to add support for Databricks photon eventlogs - #251
The text was updated successfully, but these errors were encountered:
We should skip the photon jobs for better performance. We don't want to spend additional time processing these event logs.
We could mark them as SKIPPED/FAILURE in rapids_4_spark_qualification_output_status.csv.
In details:
The suggested proposal of adding a new column is not going to be generic. It should be in the wrapper to make sure that the details/comments reflect the executive summary filters. Examples:
The “Top-candidates” view is part of the wrapper. The Top-Candidates has recommendations of its own and we won’t be able to use that in the new column.
Extending this in the future based on cost-savings or any other functionality won’t be feasible.
@cindyyuanjiang there is another open issue #845 to disqualify streaming-jobs as well.
It will be nice to come up with an implementation that can be easily extended to resolve 845 as well.
amahussein
changed the title
[FEA] Qualification tool: Disqualify Databricks Photon jobs at app level.
[FEA] Qualification tool: Disqualify Databricks Photon jobs at app level
Mar 26, 2024
Is your feature request related to a problem? Please describe.
This issue to disqualify jobs if the eventlogs are from Databricks photon. Currently, eventlogs are read and the Photon Execs are marked as unsupported since the Exec names are different from regular CPU Execs. Ex: PhotonBroadcastExchange -> BroadcastExchange.
We need to mark the job as Not Applicable if the eventlogs are from Photon runs until we add support for Photon eventlogs.
Issue to add support for Databricks photon eventlogs - #251
The text was updated successfully, but these errors were encountered: