Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: check objective in test routines #1468

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

FabianHofmann
Copy link
Contributor

Option to counter-check the objective value against expected value. With this check, we make sure that no strong deviations from the expected objective are introduced. In case the objective varies stronger than the allowed tolerance, but for a good reason (new tech/tech costs), the expected value has to be updated manually.

Changes proposed in this Pull Request

Checklist

  • I tested my contribution locally and it works as intended.
  • Code and workflow changes are sufficiently documented.
  • Changed dependencies are added to envs/environment.yaml.
  • Changes in configuration options are added in config/config.default.yaml.
  • Changes in configuration options are documented in doc/configtables/*.csv.
  • Sources of newly added data are documented in doc/data_sources.rst.
  • A release note doc/release_notes.rst is added.

Copy link
Contributor

github-actions bot commented Dec 19, 2024

Validator Report

I am the Validator. Download all artifacts here.
I'll be back and edit this comment for each new commit.

❗ Run failed!

Download 'logs' artifact to see more details.

  • master failed in: make_summary
  • test-objective failed in: make_summary

Model Metrics

Benchmarks Image not available Image not available Image not available

Comparing test-objective (1474ea7) with master (12d7107).
Branch is 1 commits ahead and 0 commits behind.
Last updated on 2024-12-20 00:45:33 CET.

@FabianHofmann FabianHofmann requested a review from lkstrp December 23, 2024 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant