Delete iree_tests/sharktank/.

[ScottTodd]

These tests are redundant with newer test suites here:

• https://github.com/iree-org/iree/tree/main/experimental/regression_suite/shark-test-suite-models (sd3 and sdxl)
  • Note that these tests use files from https://huggingface.co/amd-shark/sdxl-quant-models, while the tests there use Azure (sharkpublic)
• https://github.com/iree-org/iree-test-suites/tree/main/sharktank_models (llama)
  • Note that llama 3 tested there is different from the openlm-research/open_llama_3b_v2 model tested here, but we should move tests to iree-test-suites anyways: Organize full model integration tests in some central location iree-org/iree-test-suites#49

[ScottTodd]

I can start porting these to https://github.com/iree-org/iree-test-suites as well. Just opt-125M and resnet50 in https://github.com/nod-ai/SHARK-TestSuite/tree/main/iree_tests/pytorch/models right now since no one helped port from e2eshark x_x, we wouldn't lose much by dropping that coverage without a replacement.

[saienduri]

Cool, this makes sense. Are you going to be doing the follow up PR to remove this testing/updating pin in iree also? I actually don't think we even run any other SHARK-TestSuite tests in iree, so we can probably fully remove shark test suite from iree testing

[ScottTodd]

Cool, this makes sense. Are you going to be doing the follow up PR to remove this testing/updating pin in iree also? I actually don't think we even run any other SHARK-TestSuite tests in iree, so we can probably fully remove shark test suite from iree testing

Yeah these run in IREE: https://github.com/iree-org/iree/blob/fb4d09470dc4be674de810dbfbf2d3764e2970ba/.github/workflows/pkgci_regression_test.yml#L83-L117. That test_models matrix.

          pytest \
            SHARK-TestSuite/iree_tests/pytorch/models \
            SHARK-TestSuite/iree_tests/sharktank \

I don't mind dropping the two pytorch/models/ tests at the same time. The coverage provided there is small at the moment, and I'm reasonably close to having a replacement ready in iree-org/iree-test-suites#63.

[saienduri]

Makes sense, sgtm