Problem with preapring validation data for S3DIS

[KhairilAriffinYahya]

Whenever I try to run train_S3DIS.py the program force stop itself at validation stage. I narrow it down to cpp_subsampling function.

The error log I got:
Preparing KDTree for cloud Area_5, subsampled at 0.030
Feature and Label exist
^C

I am running on google colab.

I realize that there issue when running cpp_warpper.sh preventing it to be build properly.
Log when running "!sh compile_wrappers.sh":

running build_ext
building 'grid_subsampling' extension
Warning: Can't read registry to find the necessary compiler setting
Make sure that Python modules winreg, win32api or win32con are installed.
INFO: C compiler: x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC

creating build
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils/cloud
creating build/temp.linux-x86_64-cpython-310/grid_subsampling
INFO: compile options: '-I/usr/local/lib/python3.10/dist-packages/numpy/core/include -I/usr/include/python3.10 -c'
extra options: '-std=c++11 -D_GLIBCXX_USE_CXX11_ABI=0'
INFO: x86_64-linux-gnu-gcc: ../cpp_utils/cloud/cloud.cpp
INFO: x86_64-linux-gnu-gcc: grid_subsampling/grid_subsampling.cpp
grid_subsampling/grid_subsampling.cpp: In function ‘void grid_subsampling(std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, float, int)’:
grid_subsampling/grid_subsampling.cpp:99:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘long unsigned int’} [-Wsign-compare]
99 | for (int i = 0; i < ldim; i++)
| ~~^~~~~~
grid_subsampling/grid_subsampling.cpp: In function ‘void batch_grid_subsampling(std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, float, int)’:
grid_subsampling/grid_subsampling.cpp:140:16: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
140 | for (b = 0; b < original_batches.size(); b++)
| ~~^~~~~~~~~~~~~~~~~~~~~~~~~
grid_subsampling/grid_subsampling.cpp:181:31: warning: comparison of integer expressions of different signedness: ‘std::vector::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
181 | if (b_s_points.size() <= max_p)
| ~~~~~~~~~~~~~~~~~~^~~~~~~~
INFO: x86_64-linux-gnu-gcc: wrapper.cpp
In file included from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/ndarraytypes.h:1960,
from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/ndarrayobject.h:12,
from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/arrayobject.h:5,
from wrapper.cpp:2:
/usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
17 | #warning "Using deprecated NumPy API, disable it with "
| ^~~~~~~
wrapper.cpp: In function ‘PyObject* batch_subsampling(PyObject*, PyObject*, PyObject*)’:
wrapper.cpp:75:28: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~
wrapper.cpp:75:38: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~~
wrapper.cpp:75:49: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~~~
wrapper.cpp:75:61: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~~
wrapper.cpp:75:72: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~~~
wrapper.cpp:75:84: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~
wrapper.cpp:75:94: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~
wrapper.cpp:75:103: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
75 | static char* kwlist[] = { "points", "batches", "features", "classes", "sampleDl", "method", "max_p", "verbose", NULL };
| ^~~~~~~~~
wrapper.cpp: In function ‘PyObject* cloud_subsampling(PyObject*, PyObject*, PyObject*)’:
wrapper.cpp:350:28: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~
wrapper.cpp:350:38: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~~~
wrapper.cpp:350:50: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~~
wrapper.cpp:350:61: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~~~
wrapper.cpp:350:73: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~
wrapper.cpp:350:83: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
350 | static char* kwlist[] = { "points", "features", "classes", "sampleDl", "method", "verbose", NULL };
| ^~~~~~~~~
creating build/lib.linux-x86_64-cpython-310
INFO: x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils/cloud/cloud.o build/temp.linux-x86_64-cpython-310/grid_subsampling/grid_subsampling.o build/temp.linux-x86_64-cpython-310/wrapper.o -L/usr/lib/x86_64-linux-gnu -o build/lib.linux-x86_64-cpython-310/grid_subsampling.cpython-310-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-cpython-310/grid_subsampling.cpython-310-x86_64-linux-gnu.so ->
running build_ext
building 'radius_neighbors' extension
Warning: Can't read registry to find the necessary compiler setting
Make sure that Python modules winreg, win32api or win32con are installed.
INFO: C compiler: x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC

creating build
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils
creating build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils/cloud
creating build/temp.linux-x86_64-cpython-310/neighbors
INFO: compile options: '-I/usr/local/lib/python3.10/dist-packages/numpy/core/include -I/usr/include/python3.10 -c'
extra options: '-std=c++11 -D_GLIBCXX_USE_CXX11_ABI=0'
INFO: x86_64-linux-gnu-gcc: ../cpp_utils/cloud/cloud.cpp
INFO: x86_64-linux-gnu-gcc: neighbors/neighbors.cpp
neighbors/neighbors.cpp: In function ‘void brute_neighbors(std::vector&, std::vector&, std::vector&, float, int)’:
neighbors/neighbors.cpp:32:24: warning: comparison of integer expressions of different signedness: ‘std::vector::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
32 | if (tmp[i0].size() > max_count)
| ~~~~~~~~~~~~~~~^~~~~~~~~~~
neighbors/neighbors.cpp:47:10: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
47 | if (j < inds.size())
| ~~^~~~~~~~~~~~~
neighbors/neighbors.cpp: In function ‘void ordered_neighbors(std::vector&, std::vector&, std::vector&, float)’:
neighbors/neighbors.cpp:99:24: warning: comparison of integer expressions of different signedness: ‘std::vector::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
99 | if (tmp[i0].size() > max_count)
| ~~~~~~~~~~~~~~~^~~~~~~~~~~
neighbors/neighbors.cpp:114:10: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
114 | if (j < inds.size())
| ~~^~~~~~~~~~~~~
neighbors/neighbors.cpp: In function ‘void batch_ordered_neighbors(std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, float)’:
neighbors/neighbors.cpp:184:24: warning: comparison of integer expressions of different signedness: ‘std::vector::size_type’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
184 | if (tmp[i0].size() > max_count)
| ~~~~~~~~~~~~~~~^~~~~~~~~~~
neighbors/neighbors.cpp:199:10: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
199 | if (j < inds.size())
| ~~^~~~~~~~~~~~~
neighbors/neighbors.cpp: In function ‘void batch_nanoflann_neighbors(std::vector&, std::vector&, std::vector&, std::vector&, std::vector&, float)’:
neighbors/neighbors.cpp:296:22: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘long unsigned int’} and ‘int’ [-Wsign-compare]
296 | if (nMatches > max_count)
| ~~~~~~~~~^~~~~~~~~~~
neighbors/neighbors.cpp:321:10: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector<std::pair<long unsigned int, float> >::size_type’ {aka ‘long unsigned int’} [-Wsign-compare]
321 | if (j < inds_dists.size())
| ~~^~~~~~~~~~~~~~~~~~~
neighbors/neighbors.cpp:230:8: warning: unused variable ‘d2’ [-Wunused-variable]
230 | float d2;
| ^~
INFO: x86_64-linux-gnu-gcc: wrapper.cpp
In file included from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/ndarraytypes.h:1960,
from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/ndarrayobject.h:12,
from /usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/arrayobject.h:5,
from wrapper.cpp:2:
/usr/local/lib/python3.10/dist-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
17 | #warning "Using deprecated NumPy API, disable it with "
| ^~~~~~~
wrapper.cpp: In function ‘PyObject* batch_neighbors(PyObject*, PyObject*, PyObject*)’:
wrapper.cpp:71:28: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
71 | static char* kwlist[] = { "queries", "supports", "q_batches", "s_batches", "radius", NULL };
| ^~~~~~~~~
wrapper.cpp:71:39: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
71 | static char* kwlist[] = { "queries", "supports", "q_batches", "s_batches", "radius", NULL };
| ^~~~~~~~~~
wrapper.cpp:71:51: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
71 | static char* kwlist[] = { "queries", "supports", "q_batches", "s_batches", "radius", NULL };
| ^~~~~~~~~~~
wrapper.cpp:71:64: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
71 | static char* kwlist[] = { "queries", "supports", "q_batches", "s_batches", "radius", NULL };
| ^~~~~~~~~~~
wrapper.cpp:71:77: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings]
71 | static char* kwlist[] = { "queries", "supports", "q_batches", "s_batches", "radius", NULL };
| ^~~~~~~~
creating build/lib.linux-x86_64-cpython-310
INFO: x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 build/temp.linux-x86_64-cpython-310/cpp_wrappers/cpp_utils/cloud/cloud.o build/temp.linux-x86_64-cpython-310/neighbors/neighbors.o build/temp.linux-x86_64-cpython-310/wrapper.o -L/usr/lib/x86_64-linux-gnu -o build/lib.linux-x86_64-cpython-310/radius_neighbors.cpython-310-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-cpython-310/radius_neighbors.cpython-310-x86_64-linux-gnu.so ->