Open
Description
Currently there 3 differents ways to start Contest
:
UtBotTool2
- as separate process for SBFT, callsContestKt.main
ContestEstimatorKt.main
- callsrunEstimator
StatisticsMonitoringKt.main
- callsrunEstimator
All of these tools set options for Contest Estimator differently, which causes divergence in Grafana monitoring, local testing and result in SBFT. it is hard to repro bug occured in nightly statistics on local machine as settings differ and Grafana shows incorrect results.
Entry points should be reduced to single one, which will be used for all scenarios with same arguments.
Proposed solution:
- Merge
ContestEstimator
andStatisticsMonitoring
in a single class, which will be used as an entry point both at CI and CLI. - New entry point should have clean and simple way to configurate execution. Default arguments should correspond to statistics monitoring scenario and should work both from CI and CLI(for local repro).
- Nice to have, but not mandatory: New entry point should use
UtBotTool2
for generation. Monitoring will work as it is used in SBFT.
This would allow run this utbot-junit-contest
in a single way as from CLI and Gradle.
Additional:
It is important either not to break current monitoring scripts or completely rewrite them.
Metadata
Metadata
Assignees
Type
Projects
Status
Todo