-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to get cameraToWorldUnity matrix? #1
Comments
Thanks for your interest in this project, @luffy-yu! Unfortunately, with the current MixedReality-WebRTC implementation, there is no access provided to the synced per-frame I am sure there is a way to modify the WebRTC implementation to access the per-frame camera parameters (intrinsic and extrinsic) of the HoloLens 2, but I didn't have the time to investigate. |
@doughtmw Thanks for your detailed reply. I have dived into HoloLens 2 for a long time. I did find a solution to stream camera parameters along with the video frame. It works as expected, but it is based on socket rather than WebRTC. Besides that, its client works on Python, not C#. It should not be hard to make some adaptations. |
@doughtmw I figured out streaming extrinsic parameters of the left front camera, i.e., A sample is like
You see some numbers are very large, while some are very small. Does it make sense? |
@luffy-yu awesome! The results seem to be a bit strange though, I'm wondering if there's an error in the way you're debugging the matrix params (float vs double for example)? In this repo, the
|
@doughtmw I gave up the solution of getting extrinsic parameters via |
Thanks for your nice work.
I'm trying to understand the whole procedure, but I can't figure out where the
CameraToWorldUnity
matrix comes from. I saw you put it in a text file. How do you get it?The text was updated successfully, but these errors were encountered: