Upstream 3 features for torch-trt: ms, VC, and optimisation level

[wu6u3tw]

Description

Upstream options:

• max_aux_streams
• version_compatible
• optimization_level

Fixes # (issue)

Type of change

Please delete options that are not relevant and/or add your own.

• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

Checklist:

• My code follows the style guidelines of this project (You can use the linters)
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas and hacks
• I have made corresponding changes to the documentation
• I have added tests to verify my fix or my feature
• New and existing unit tests pass locally with my changes
• I have added the relevant labels to my PR in so that relevant reviewers are notified

[wu6u3tw]

@nvpohanh for viz.

[narendasan]

@wu6u3tw can you mirror these changes for the fx_ts_compat frontend as well? Doesnt need to be the same PR but these changes seem useful for that as well

[wu6u3tw]

Yes, can do this on another PR.

[nvpohanh]

Looks good to me now.

@wu6u3tw can you mirror these changes for the fx_ts_compat frontend as well? Doesnt need to be the same PR but these changes seem useful for that as well

@wu6u3tw Could you address @narendasan 's this comment? Thanks

[wu6u3tw]

Looks good to me now.

@wu6u3tw can you mirror these changes for the fx_ts_compat frontend as well? Doesnt need to be the same PR but these changes seem useful for that as well

@wu6u3tw Could you address @narendasan 's this comment? Thanks

Draft in prog. Will be PR out today.

[nvpohanh]

@narendasan Anything blocking this PR from being merged?

[narendasan]

We need @frank-wei or someone on Meta's side to review this since this is an API change that might effect their stack

[nvpohanh]

@frank-wei Could you review this? It has been 3 weeks since last update

[narendasan]

We are just going to close this since its in dynamo