Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running evaluation on BOP datasets #276

Open
OrestisVaggelis opened this issue Dec 16, 2024 · 1 comment
Open

Running evaluation on BOP datasets #276

OrestisVaggelis opened this issue Dec 16, 2024 · 1 comment

Comments

@OrestisVaggelis
Copy link

I’m attempting to run the pose estimation evaluation on all standard BOP datasets using the current datareader.py implementation with minimal modifications to run_linemod.py. While I achieve very reasonable (in fact higher than reported) results on LMO and YCBV, the results for ICBIN, TLESS, and TUDL are unexpectedly low.

Are there any additional changes needed in run_linemod.py, datareader.py, or elsewhere to properly handle ICBIN, TLESS, and TUDL?

@wenbowen123
Copy link
Collaborator

Hi, as mentioned in the readme, the released weights are not exactly the same as what we used to run the experiments (excluding the diffusion augmented data, due to licensing issues). It might worth checking how do those failure cases look like on "ICBIN, TLESS, and TUDL" to understand why.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants