Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

channels_last transformation support for branching models #100

Open
nghielme opened this issue Feb 14, 2024 · 1 comment
Open

channels_last transformation support for branching models #100

nghielme opened this issue Feb 14, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@nghielme
Copy link

I am working with a UNet model in ONNX format and I needed to move channels from first to last. I tried using the following pass https://github.com/fastmachinelearning/qonnx/blob/main/src/qonnx/transformation/channels_last.py but at the moment it seems it does not support branching model. I also noticed that something similar has been implemented in hls4ml, exploiting configuration parameters coming from PyTorch, https://github.com/fastmachinelearning/hls4ml/blob/fcd9c58d977ee7684e21d81cc13f124c9aa4209c/hls4ml/model/optimizer/passes/convert_to_channels_last.py
Is there any ongoing work on this? If not, if anyone has any kind of guideline/slides on how to support this feature I would be happy to contribute.

@nghielme nghielme added the enhancement New feature or request label Feb 14, 2024
@maltanar
Copy link
Collaborator

Just to keep this issue updated, the recently-merged PR #149 should be able to do channels-last conversion for branching topologies, but U-Nets with Resize nodes and similar probably need more feature development on top.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants