Add NNI's CI

[ultmaster]

Before submitting

• Was this discussed/approved via a GitHub issue? integrate with Lightning ecosystem CI microsoft/nni#4504
• Did you create/update your configuration file?
• Did you add your config to CI - GitHub action and Azure pipeline?
• Are all integration tests passing? - how should I test it?

What does this PR do? [optional]

Integrate NNI's test into lightning, so that we are aware of the upstream changes.
Thanks Lightning team for your support!
Resolves microsoft/nni#4504

Did you have fun?

Make sure you had fun coding 🙃

[codecov]

Codecov Report

Merging #32 (5539cd8) into main (400ad67) will decrease coverage by 0%.
The diff coverage is 91%.

Additional details and impacted files

@@        Coverage Diff         @@
##           main   #32   +/-   ##
==================================
- Coverage    85%   85%   -0%     
==================================
  Files         2     2           
  Lines       230   234    +4     
==================================
+ Hits        196   199    +3     
- Misses       34    35    +1     

[ultmaster]

Hi @Borda , looks like my work is done here.

For rest of the tests, building dockers lacks credential, and I'm not sure whether codecov is a necessary condition.
You might want to double-check the changes I've made to assistant.py, and maybe reshape them to be whatever you want.

Unfortunately, NNI doesn't work with pytorch-lightning on the master branch (5 tests failed). I'll ask my colleagues to look at it. As it's approaching Lunar's new year in China and people are on vacation, I don't expect that it can be quickly solved. Let's pin it to lightning v1.5.x for now.

[ultmaster]

Hi @Borda , I'm writing to check the status of this pull request. What's the status here? Are there any blocking issues? Anything I can help?

[Borda]

What's the status here? Are there any blocking issues? Anything I can help?

yep, sorry, was busy somewhere else, but hopefully get to it soon