Future Dev: Alerting Logical File Skew

[BaharF]

This ticket is a requirement from ASR to be build in the future.

Providing an alert on logical file skew,

• Calculate the mean filepart size of the set
• Calculate standard deviation of filepart sizes in the set
• Compare standard deviation to mean filepart size
• If one standard deviation exceeds x% (somewhere around 30-40%) of average filepart size, flag the file for poor distribution
• If max skew (max filepart size compared to mean) exceeds x% (somewhere around 300-500%), flag the file

Creating this alert will help improving overall performance / mitigate under and over-utilization of nodes, assuming users subsequently take corrective action.