Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Defect] Inconsistent results using SophireadStream #4

Open
suannchong opened this issue Apr 17, 2023 · 0 comments
Open

[Defect] Inconsistent results using SophireadStream #4

suannchong opened this issue Apr 17, 2023 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@suannchong
Copy link
Contributor

When running SophireadStream on the same file same machine, inconsistent results were observed.

image
image

Chen's comments:

  • It is possible for SophireadStream to generate different results because the performance of the processing thread is not guaranteed to be the same between different runs. If you increase the batch size, the difference might become smaller.
  • Alternatively, we need to implement a solution to deal with the tail of each batch size, which should help mitigate the issue.
@suannchong suannchong added the bug Something isn't working label Apr 17, 2023
@suannchong suannchong changed the title Inconsistent results using SophireadStreamWhen running SophireadStream on the same file same machine, inconsistent results were observed. ![Screenshot_2023-03-02_at_11.53.08_AM](/uploads/8f9ff3e28a76d85861867a7b78e79023/Screenshot_2023-03-02_at_11.53.08_AM.png) ![Screenshot_2023-03-02_at_11.52.36_AM](/uploads/207ba70b4c7da5bcfa375fb0a7892102/Screenshot_2023-03-02_at_11.52.36_AM.png) Chen's comments: - It is possible for SophireadStream to generate different results because the performance of the processing thread is not guaranteed to be the same between different runs. If you increase the batch size, the difference might become smaller. - Alternatively, we need to implement a solution to deal with the tail of each batch size, which should help mitigate the issue. Inconsistent results using SophireadStream Apr 17, 2023
@suannchong suannchong changed the title Inconsistent results using SophireadStream [Defect] Inconsistent results using SophireadStream Apr 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants