Testbed Automation

[susanta-mukhopadhyay]

Do we have any plan for providing automated testbed for the APIs we are generating? It may be simple newman script with option to feed data, which can be integrated with CI pipeline easily.

[kdhrubo]

It will be good if you can elaborate more on this. How do you expect this to work end to end ?

Open API specification will be available in next release. Is it possible to generate Newman script from it ?

[kdhrubo]

May be we can provide another end point that generates these test scripts to download?

or a cli ? more work i believe

[thadguidry]

I'd recommend Playwright because it can handle a multitude of different contexts out-of-the-box. I only used it once for light HTML browser testing because it can generate tests easily in UI, but have heard that it's API testing is also very good because of the Testing options and advanced configuration it offers.

[kdhrubo]

Don't see any scripting options that playwright can drive.

For Newman , it can drive any postman collection from pipeline..

[susanta-mukhopadhyay]

I have not used Playwright, but another option is bruno. It provides option to create test collection script as well and slightly better in performance. https://github.com/usebruno/bruno .

[kdhrubo]

Also httpie.

[kdhrubo]

I believe we can provide a CLI that should create these scripts and keep it away from main db2rest

[kdhrubo]

How do we know what to test besides the generic crud ?

[susanta-mukhopadhyay]

Good point. Can we provide some interface or command to generate generic test script with option to edit and provide test data? Based on the column names we can also think of providing separate json file to be parsed and picked up by the test scripts.

[susanta-mukhopadhyay]

While using it in development, end user will anyway need test script to be integrated in their pipeline. If we can provide some automation it will be value addition for this product.