Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom camera input #4

Open
turtlebot1 opened this issue Feb 23, 2024 · 2 comments
Open

Custom camera input #4

turtlebot1 opened this issue Feb 23, 2024 · 2 comments

Comments

@turtlebot1
Copy link

How to use custom camera input and process them instead of using the simulation output of unreal engine?
Please let me know about it.
Thank you

@Embracing
Copy link
Owner

Embracing commented Feb 27, 2024

We define the action space of cameras here. It is actually a matrix of [C, 5] with values 0-2. C is the number of cameras. 5 is the dimensions to take action. Please see this.

Take a single camera as example. It can move along xyz and rotate with pitch and yaw angle. If you set an action as [0, 1, 2, 0, 1], it will move along x and z-axis with a step of -30 and 30, and rotate with pitch angle of -3 degree. Stride is defined here.

If you would like to use custom camera input, you may need to modify the stride to fit your custom camera's config and only use the action dimensions where your camera is able to take an action.

@turtlebot1
Copy link
Author

Thank you very much for your valuable assistance. For my specific use-case, I am particularly interested in the 'Perception Module' as outlined in your manuscript. Could you please guide me to where I can find the relevant code for this module? Any assistance in this regard would be greatly appreciated.

Thank you once again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants