Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Support live statistics in progress bar #674

Open
tw-aisi opened this issue Oct 9, 2024 · 1 comment
Open

[Feature Request] Support live statistics in progress bar #674

tw-aisi opened this issue Oct 9, 2024 · 1 comment

Comments

@tw-aisi
Copy link
Contributor

tw-aisi commented Oct 9, 2024

Right now the progress bar that shows when one runs inspect eval does not show any running statistics. Sometimes a small fraction of evals can take twice as long or longer than the rest of evals, and it would be convenient in these scenarios to be able to view a running statistic to know how well the run is doing.

@jjallaire
Copy link
Collaborator

Note that we very soon be working on improved live task display (including both statistics as well as drilling down into what's happening w/ individual samples)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants