You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new class would add a new metric that takes a list of dataloader (resulting from multiple attack runs) and produce a compound metric that evaluates the worst-case prediction over the trials.
The trick is to collect all y_preds from the different loaders, and when computing the accuracy, add a minimum over the "correctness" of the predictions.
The new class would add a new metric that takes a list of dataloader (resulting from multiple attack runs) and produce a compound metric that evaluates the worst-case prediction over the trials.
The trick is to collect all y_preds from the different loaders, and when computing the accuracy, add a minimum over the "correctness" of the predictions.
Example:
This is the implementation:
A new metric will be added in
metrics.classification
.The text was updated successfully, but these errors were encountered: