-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Questions about Inference results #27
Comments
Does this comment help you? For the yaw angle it says that |
The prediction of angle may be not quite accurate. And also we don't make much difference between rotation on 90 degrees. You can see more details on angle question in FCAF3D paper. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello. This time, I want to do 3D object detection of a cube with w, l, and h all of 0.04(m) through an rgb-d camera, so I am using this package. This is my first time doing this kind of work, Also, I'm still not good at English, so please understand that part. .
First, I create a data set and talk about the direction in which we proceed, and then ask questions at the end.
1. Understanding how sunrgbd data is processed and Make sunrgbd data
Label
In the tools/data_converter/sunrgbd_data_utils.py file, there is following code.
As mentioned in the code above, labeling consists of a total of 13 items, and the following label .txt files were created accordingly. At this time, I thought I would only use the point cloud, so I arbitrarily entered the value 1 1 2 2 for the 2d bbox.
box 1 1 2 2 -0.024179 0.896166 0.111629 0.04 0.04 0.04 1.000000 0.000000
Depth
In the case of the depth file, the x, y, z, r, g, and b values were entered in that order. At this time, r, g, and b values were assigned values between 0 and 1.
2. Train
I ran a train according to the code below.
3. Inference
I ran a Inference according to the code below
4. Problem in inference
Difference between label z value and inferred z value
![+0 105](https://private-user-images.githubusercontent.com/81359054/315839963-a3d5943f-af6d-458e-9b88-74134ad1029c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYwOTU0OTEsIm5iZiI6MTcyNjA5NTE5MSwicGF0aCI6Ii84MTM1OTA1NC8zMTU4Mzk5NjMtYTNkNTk0M2YtYWY2ZC00NThlLTliODgtNzQxMzRhZDEwMjljLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTExVDIyNTMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTE4ZjY5MWIzYzY3ZjgxOTg0ODkzMzFkYWI3MTg1YjdhN2I4N2I1ZDIxYTQyYjkwOTU4MWZlZDNkYjFkMWM3N2YmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Tu3VUJW7kinR49nk2jFoP30AzVJ9Psfr-hubs0YFO58)
![show_result](https://private-user-images.githubusercontent.com/81359054/315840647-ffff6f90-f85f-496f-a332-950ec4a0b128.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYwOTU0OTEsIm5iZiI6MTcyNjA5NTE5MSwicGF0aCI6Ii84MTM1OTA1NC8zMTU4NDA2NDctZmZmZjZmOTAtZjg1Zi00OTZmLWEzMzItOTUwZWM0YTBiMTI4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTExVDIyNTMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTc3MjAwMjhmNGRlY2I0MDExZTRiNGUxMTY3YmM1Y2E5YjlmMDcxZjdhZDk5NTVmNDk3NjI2MDAxNWU3NmI3OTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.m_ViHNRpwcNyNEnmDLPzevWt3avMWwn8dGFpGROCMU4)
![infer_bottom](https://private-user-images.githubusercontent.com/81359054/315840545-9d43548d-4172-4476-95d7-39c762d9d5f9.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYwOTU0OTEsIm5iZiI6MTcyNjA5NTE5MSwicGF0aCI6Ii84MTM1OTA1NC8zMTU4NDA1NDUtOWQ0MzU0OGQtNDE3Mi00NDc2LTk1ZDctMzljNzYyZDlkNWY5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTExVDIyNTMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY1MDBiZGZkODEzNTFkMTdkM2NmMWQwOWFmMjU4ZTQ3OTE2YjZhMDQ1ODA3NTAxNTA5NjkxMjc4OWQyOGI2ZWQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.V5tiJ-PGluLQxnHA5Dqk5rrRasBO582xKB9GW9yE2Ho)
In the label file and in reality, the z value is 0.11, but the inference result value is 0.0759.
Also, if I perform inference with a cube on the floor, I will even get a negative number.
So, I visualized and confirmed the point cloud used in the dataset. As a result, if you look at the photo below, you can see that it has a shape with a center of approximately 0.11.
![pc vis](https://private-user-images.githubusercontent.com/81359054/315840982-407441e6-75d9-49e3-a103-e0eada9a9d35.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYwOTU0OTEsIm5iZiI6MTcyNjA5NTE5MSwicGF0aCI6Ii84MTM1OTA1NC8zMTU4NDA5ODItNDA3NDQxZTYtNzVkOS00OWUzLWExMDMtZTBlYWRhOWE5ZDM1LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTExVDIyNTMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTkwZWRiZDQzZmNlODU2ODNhZTFiYzM4MjgzMjljZWJjNDIwN2Q2YTk3ZjlkZTI5MDc4ZWQxZjY3M2IzZTRiZjAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.llnqTb5UyaDVTTHdXkYaL_ux4jIwAZBtenvhx2hocJk)
My question here is that the x and y coordinate values are pretty accurate, but I don't know why there is an error in the z value.
Yaw value
![image (9)](https://private-user-images.githubusercontent.com/81359054/315866675-2e5126d3-1b5e-4b18-a78f-b0d6c5cf4220.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjYwOTU0OTEsIm5iZiI6MTcyNjA5NTE5MSwicGF0aCI6Ii84MTM1OTA1NC8zMTU4NjY2NzUtMmU1MTI2ZDMtMWI1ZS00YjE4LWE3OGYtYjBkNmM1Y2Y0MjIwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTExVDIyNTMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWMzNDM1YTk4OGUxNGUzYjE2YmIyZGI5N2ViNWIxOTAzYTUwMDJmZDNmZWM0NjM1M2JhODQ1NjBhZDhmNzkzZGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.JcKK9A00CPs2CHcRnazTL9Jw3OrBWUuA9dFPUrKqnOA)
Train was performed and when Infer was performed with the same data, an incomprehensible yaw value was obtained. The result is as follows, mid and max on the left mean distance, and the value on the right means rad (degree).
max_clock_15 -> 0.08926178 (5.11˚)
max_clock_30 -> -1.3506540 (-77.39˚)
max_clock_45 -> 1.5099705 (86.51˚)
max_clock_60 -> 1.34937334 (77.31˚)
max_clock_75 -> 1.3324995 (76.35˚)
max_straight -> 0.04222381 (2.42˚)
mid_clock_15 -> 1.5214607 (87.17˚)
mid_clock_30 -> 1.4977183 (85.81˚)
mid_clock_45 -> 1.5112293 (86.59˚)
mid_clock_60 -> 1.4744493
mid_clock_75 -> 1.5131842
mid_straight -> 1.4999024
There seems to be a problem with labeling. Can you explain in more detail the method when giving angle values within labeling?
If there is anything missing, please let me know. thank you
The text was updated successfully, but these errors were encountered: