Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WebNN] Add op support validation for decomposed WebNN ops #23370

Merged
merged 3 commits into from
Feb 11, 2025
Merged

[WebNN] Add op support validation for decomposed WebNN ops #23370

merged 3 commits into from
Feb 11, 2025

Conversation

Honry
Copy link
Contributor

@Honry Honry commented Jan 15, 2025

  • Some ONNX op are supported by decomposed WebNN ops, defines a decomposed_op_map map to specific decomposed WebNN ops list.
  • WebNN ops have various first input names such as 'a', 'input', 'inputs', etc. Defines a webnn_op_first_input_name_map map to record special names other than 'input', and a GetWebNNOpFirstInputName function to retrieve the first input name of a WebNN op.
  • Check if the input and output data types are supported by each decomposed WebNN op.
  • Remove the unnecessary CheckSingleOp function, because WebNN's OpSupportLimits has already covered op supported check.

@Honry
Copy link
Contributor Author

Honry commented Jan 15, 2025

@fdwr, @guschmue, PTAL, thanks!

@guschmue guschmue added the ep:WebNN WebNN execution provider label Jan 16, 2025
@guschmue
Copy link
Contributor

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@guschmue
Copy link
Contributor

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 2 pipeline(s).

@guschmue
Copy link
Contributor

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@guschmue
Copy link
Contributor

/azp run Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline, Win_TRT_Minimal_CUDA_Test_CI

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@Honry
Copy link
Contributor Author

Honry commented Jan 17, 2025

@fdwr, @guschmue, I just rebase the PR to solve the merge conflict, pls. help retrigger the CIs, thanks!

fdwr
fdwr previously approved these changes Jan 18, 2025
View reviewed changes
Copy link
Contributor

@fdwr fdwr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 A question and suggestion, but else LGTM.

@fdwr
Copy link
Contributor

fdwr commented Jan 18, 2025

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 18, 2025

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 18, 2025

/azp run Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI

@fdwr
Copy link
Contributor

fdwr commented Jan 18, 2025

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 2 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

Honry
Honry commented Jan 20, 2025
View reviewed changes
Copy link
Contributor Author

@Honry Honry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fdwr, comments addressed, PTAL again, thanks!

fdwr
fdwr reviewed Jan 22, 2025
View reviewed changes
Copy link
Contributor

@fdwr fdwr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One important comment (about data), else LGTM. TY.

@fdwr
Copy link
Contributor

fdwr commented Jan 22, 2025

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 22, 2025

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 22, 2025

/azp run Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI

@fdwr
Copy link
Contributor

fdwr commented Jan 22, 2025

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 2 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

Honry added 3 commits January 22, 2025 15:54
@Honry
[WebNN] Add op support validation for decomposed WebNN ops
a10b328 
- Some ONNX op are supported by decomposed WebNN ops, defines a decomposed_op_map
  map to specific decomposed WebNN ops list.
- WebNN ops have various first input names such as 'a', 'input', 'inputs', etc.
  Defines a webnn_op_first_input_name_map map to record special names other than
  'input', and a GetWebNNOpFirstInputName function to retrieve the first input name
  of a WebNN op.
- Check if the input and output data types are supported by each decomposed WebNN op.
- Remove the unnecessary CheckSingleOp function, WebNN's OpSupportLimits has already
  covered op supported check.
@Honry
Addressed comments
2db7307 
- Don't pass immutable simple int value by reference
- Populate std::string_view, std::map
@Honry
Revert using string_view.data()
bf3f9e0
Honry
Honry commented Jan 22, 2025
View reviewed changes
Copy link
Contributor Author

@Honry Honry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fdwr, comments addressed, pls. take another look ❤

fdwr
fdwr approved these changes Jan 23, 2025
View reviewed changes
Copy link
Contributor

@fdwr fdwr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@fdwr
Copy link
Contributor

fdwr commented Jan 23, 2025

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 23, 2025

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

@fdwr
Copy link
Contributor

fdwr commented Jan 23, 2025

/azp run Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline,Win_TRT_Minimal_CUDA_Test_CI

@fdwr
Copy link
Contributor

fdwr commented Jan 23, 2025

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 2 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

1 similar comment
@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 4 pipeline(s).

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 9 pipeline(s).

@Honry
Copy link
Contributor Author

Honry commented Feb 10, 2025

@fdwr, @guschmue, could you please retrigger the failure CIs? Thanks!

@fdwr
Copy link
Contributor

fdwr commented Feb 10, 2025

@fdwr, @guschmue, could you please retrigger the failure CIs? Thanks!

The only failing test was ONNX Runtime Web CI Pipeline. Restarted.

@Honry
Copy link
Contributor Author

Honry commented Feb 11, 2025

@fdwr, @guschmue, could you please retrigger the failure CIs? Thanks!

The only failing test was ONNX Runtime Web CI Pipeline. Restarted.

@fdwr, did you restart it? I didn't see the new message. 🤔

@fdwr
Copy link
Contributor

fdwr commented Feb 11, 2025 •
edited
Loading

@fdwr, did you restart it? I didn't see the new message. 🤔

Yeah, there are a few different ways to restart it. If you use the "Rerun failed tasks", then you don't see a message:

image

I still see this error:

Download artifact to: D:\a_work\1
##[error]Artifact __commit was not found for build 1596372.

Trying again :/.

@fdwr
Copy link
Contributor

fdwr commented Feb 11, 2025

/azp run ONNX Runtime Web CI Pipeline, ONNX Runtime Web CI Pipeline (Build_web_Release build_onnxruntime_web)

@azure-pipelines Azure Pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@fdwr
Copy link
Contributor

fdwr commented Feb 11, 2025

/azp run ONNX Runtime Web CI Pipeline (Build_web_Release build_onnxruntime_web)

@azure-pipelines Azure Pipelines
Copy link

No pipelines are associated with this pull request.

@fdwr fdwr merged commit 5fa8bd0 into microsoft:main Feb 11, 2025
82 checks passed
guschmue pushed a commit that referenced this pull request Mar 6, 2025
@Honry @guschmue
[WebNN] Add op support validation for decomposed WebNN ops (#23370)
523f905 
- Some ONNX op are supported by decomposed WebNN ops, defines a
`decomposed_op_map` map to specific decomposed WebNN ops list.
- WebNN ops have various first input names such as 'a', 'input',
'inputs', etc. Defines a `webnn_op_first_input_name_map` map to record
special names other than 'input', and a `GetWebNNOpFirstInputName`
function to retrieve the first input name of a WebNN op.
- Check if the input and output data types are supported by each
decomposed WebNN op.
- Remove the unnecessary `CheckSingleOp` function, because WebNN's
`OpSupportLimits` has already covered op supported check.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@fdwr fdwr fdwr approved these changes

Assignees
No one assigned
Labels
ep:WebNN WebNN execution provider
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Honry @guschmue @fdwr