Skip to content

[Backend Tester] Report delegation statistics #12846

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: gh/GregoryComer/92/head
Choose a base branch
from

Conversation

GregoryComer
Copy link
Member

@GregoryComer GregoryComer commented Jul 25, 2025

Report total number of delegated and undelegated nodes and breakdown by operator count.

Important Note: This includes a placeholder change in EdgeProgramManager to preserve the original edge graph. This will be replaced with the edge graph from the ETRecord when it's available with to_edge_transform_and_lower. I'm keeping this PR in draft until then.

Example from CoreML add:

Test ID Test Case Backend Delegated Nodes Undelegated Nodes Delegated Ops Undelegated Ops
test_add_dtype_float32_coreml test_add_dtype coreml 1 0 {'aten::add.Tensor': 1} {}
test_add_dtype_float32_coreml_static_int8 test_add_dtype coreml 7 0 {'aten::add.Tensor': 1, 'quantized_decomposed::dequantize_per_tensor': 3, 'quantized_decomposed::quantize_per_tensor': 3} {}

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Jul 25, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12846

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 4719c90 with merge base 4fd2079 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 25, 2025
GregoryComer added a commit that referenced this pull request Jul 25, 2025
ghstack-source-id: cc7e564
ghstack-comment-id: 3115647824
Pull-Request: #12846
@GregoryComer
Copy link
Member Author

For reviewers, is there a better way to present the operator counts? Are there other delegation-related stats that we should include?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants