Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Establish e2e benchmarking framework #318

Merged
merged 35 commits into from
Oct 25, 2024

Conversation

arinkulshi-skylight
Copy link
Collaborator

Description

#255

Screenshots (if applicable)

Related Issues

[Link any related issues or tasks from your project management system.]

Checklist

  • The title of this PR is descriptive and concise.
  • My changes follow the style guidelines of this project.
  • I have added or updated test cases to cover my changes.
  • I've let the team know about this PR by linking it in the review channel

@arinkulshi-skylight arinkulshi-skylight marked this pull request as ready for review October 21, 2024 22:28
Comment on lines 112 to 113
total_confidence = sum(item["confidence"] for item in metrics)
avg_confidence = total_confidence / len(metrics) if metrics else 0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
total_confidence = sum(item["confidence"] for item in metrics)
avg_confidence = total_confidence / len(metrics) if metrics else 0
from statistics import mean
avg_confidence = mean(item["confidence"] for item in metrics) if metrics else 0

@arinkulshi-skylight
Copy link
Collaborator Author

A note to point out is this calls image OCR directly this does not call the API.

@arinkulshi-skylight arinkulshi-skylight added this pull request to the merge queue Oct 25, 2024
Merged via the queue into main with commit 3ea8ded Oct 25, 2024
2 checks passed
@arinkulshi-skylight arinkulshi-skylight deleted the establish-e2e-benchmarking-framework branch October 25, 2024 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Benchmarking Framework] Establish e2e benchmarking framework
3 participants