Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New oracle needed to detect if the changed config is rolled out #61

Closed
tylergu opened this issue Apr 1, 2022 · 1 comment
Closed

New oracle needed to detect if the changed config is rolled out #61

tylergu opened this issue Apr 1, 2022 · 1 comment
Assignees
Labels
enhancement New feature or request low-pri low priority

Comments

@tylergu
Copy link
Member

tylergu commented Apr 1, 2022

The bug in zookeeper #59 is caused because the config is translated into a configMap object, but the application is not restarted to reflect the changed configs. koperator also had a very similar bug like this.

In our current oracles, we are not able to detect such bugs. In the input delta, Acto would see that a config field is changed. Then Acto tries to find a matching delta in the application state. It successfully finds a matching delta in the configMap object, thus passes the check.

To detect such bugs, I can think of two ways:

  1. We need to first recognize which field represents the application config. Then when this field changes, we apply an additional oracle to check if application restarted or not. This is heuristic, because not all applications/configurations need to restart the application to roll out the changed config.
  2. The second way is to provide an interface to allow users to do special checking for certain fields. Users could register a callback function to the config field as an extension of the oracle. The callback function will be called as part of the oracle when the test case change the config field. Inside the callback function, it implements the mechanism to check whether the changed config is applied on the application.
@tylergu
Copy link
Member Author

tylergu commented Jul 4, 2023

Added custom oracle

@tylergu tylergu closed this as completed Jul 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request low-pri low priority
Projects
None yet
Development

No branches or pull requests

6 participants