Question about depth maps' scale

[zcc00210]

Hi,
I rendered the depth map based on the latest version of the code. When the depth map was projected to the point cloud, there was a problem that multiple frames could not be aligned, as shown in the following figure:

Only two frames of the depth map are projected onto 3d, and there is a great distance between them, but looking at the 3d point cloud of each frame alone is correct.

So I want to ask if it is necessary to scale these depth values, such as multiplying by a scale?