Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading poses into COLMAP #66

Open
weders opened this issue May 11, 2022 · 3 comments
Open

Loading poses into COLMAP #66

weders opened this issue May 11, 2022 · 3 comments

Comments

@weders
Copy link

weders commented May 11, 2022

I need to load the poses obtained from this dataset into COLMAP. While I am aware of this thread, following it does not yield satisfactory results.

Given the convention, one would need to invert the y-axis and z-axis of the pose such that it aligns with the CV camera convention (x right, y down, z in camera viewing direction). However, this does not give correct results. Is any preprocessing happening between raw ARKit poses and the ones stored in the geometry.pbdata file?

Thanks!

@ahmadyan
Copy link
Collaborator

The geometry.pbdata contains the original ARKit camera poses.

@lzhang57 did this the other way around (bringing COLMAP camera poses to our coordinates without any problem. The result are written in sfm_arframe.pbdata file next to geometry.pbdata. The pose/point cloud in sfm_arframe.pbdata is computed using COLMAP then converted to our coordinate system.

@weders
Copy link
Author

weders commented May 12, 2022

Thanks a lot for the answer! Is this code for the COLMAP conversion available?

@lzhang57
Copy link
Collaborator

Hi weder,

When converting camera coordinates from COLMAP to our convention, we left multiplied the view_matrix with the below adjust_matrix, which swaps x and y and inverts z:

adjust_matrix = np.array(
    [[0.,   1.,   0.],
     [1.,   0.,   0.],
     [0.,   0.,  -1.] ])

You can just do it reversely.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants