Develop end-to-end testing suite for all full system testing in Federated Learning #37
Labels
Priority: 2 - High 😰
Should be fixed as quickly as possible, ideally within the current or following sprint
Severity: 3 - Medium 😒
Does not cause a failure, impair usability, or interfere with the system
Status: Available 👋
Available for assignment, who wants it?
Type: Epic 🤙
Describes a large amount of functionality that will likely be broken down into smaller issues
This issue doesn't need to live in syft-proto, but it must exist as some sort of a Github issue somewhere. This project is probably the best central location for it for now.
This issue describes how we will need to develop a testing suite that can run span multiple repositories, languages, and environments. We want to ensure that our worker libraries (syft.js, KotlinSyft, SwiftSyft, and PySyft's FL Worker) are always working properly with PyGrid. Likewise, we'll need to test this on various versions of syft-proto and Threepio to ensure that our assisting libraries pair nicely with the other various projects. We need to do roughly the following:
We should ideally cover the following cases, at the minimum:
server_config
's?Update 29/05/2020 - We do not currently have any plans to include KotlinSyft or SwiftSyft in our end-to-end testing because of their dependence on a live device or an emulator. Until we have the ability to implement these libraries in a "headless" context, they will not be practical to test end-to-end. We're open to challenging this thought and would love to implement them, but don't see a clear path at the moment.
The text was updated successfully, but these errors were encountered: