You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Establish e2e benchmarking framework by using the created reportvision-dataset-1
we want to automate the measurement or accuracy and speed for running that dataset into the ocr pipeline
Acceptance Criteria
write automated tests to measure e2e OCR reportVision accuracy and time to run against the reportvision-dataset-1
also measure the confidence accuracy and at what confidence level are the results not correct
create the templates manually or using frontend, creating the templates should not be part of the benchmark
store the benchmark with all required data/scripts on a benchmark/reportvision-dataset-1 with clear documentation on how to run it.
Additional context
for python example tests, look at OCR model benchmark tests
The text was updated successfully, but these errors were encountered:
Establish e2e benchmarking framework by using the created
reportvision-dataset-1
we want to automate the measurement or accuracy and speed for running that dataset into the ocr pipeline
Acceptance Criteria
reportvision-dataset-1
benchmark/reportvision-dataset-1
with clear documentation on how to run it.Additional context
The text was updated successfully, but these errors were encountered: