Building a graph stalls during 'Parse OSM Nodes'

[AdamWelch1]

I'm trying to build a graph from us-latest.osm.pbf, a 10.9Gb file. The system has 128Gb of RAM, of which I've allocated 80Gb to the java process. During the 'Parse OSM Nodes' step, it starts processing the data at a decent speed, then suddenly stopped making any progress 6.7Gb into the process.

Here is the relevant output from OTP:

21:46:54.056 INFO (OpenStreetMapProvider.java:115) Parse OSM Ways progress tracking complete. 10.9 GB done in 7m36s (23.9 MB per second).
21:47:33.324 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress tracking started.
21:47:38.401 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 133.7 MB of 10.9 GB ( 1%)
21:47:43.403 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 278.0 MB of 10.9 GB ( 2%)
21:47:48.404 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 398.5 MB of 10.9 GB ( 3%)
21:47:53.406 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 527.6 MB of 10.9 GB ( 4%)
21:47:58.406 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 679.9 MB of 10.9 GB ( 6%)
21:48:03.406 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 846.9 MB of 10.9 GB ( 7%)
21:48:08.407 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 918.2 MB of 10.9 GB ( 8%)
21:48:13.408 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.1 GB of 10.9 GB ( 9%)
21:48:18.412 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.2 GB of 10.9 GB (11%)
21:48:23.412 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.3 GB of 10.9 GB (12%)
21:48:28.413 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.4 GB of 10.9 GB (12%)
21:48:33.414 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.5 GB of 10.9 GB (13%)
21:48:38.416 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.6 GB of 10.9 GB (14%)
21:48:43.417 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.6 GB of 10.9 GB (15%)
21:48:48.418 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.7 GB of 10.9 GB (15%)
21:48:53.420 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.8 GB of 10.9 GB (16%)
21:48:58.421 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 1.9 GB of 10.9 GB (17%)
21:49:03.422 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.1 GB of 10.9 GB (18%)
21:49:08.423 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.2 GB of 10.9 GB (19%)
21:49:13.424 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.2 GB of 10.9 GB (20%)
21:49:18.425 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.3 GB of 10.9 GB (21%)
21:49:23.426 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.4 GB of 10.9 GB (21%)
21:49:28.427 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.5 GB of 10.9 GB (22%)
21:49:33.429 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.5 GB of 10.9 GB (23%)
21:49:38.431 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.6 GB of 10.9 GB (24%)
21:49:43.432 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.7 GB of 10.9 GB (24%)
21:49:48.432 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.8 GB of 10.9 GB (25%)
21:49:53.432 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.9 GB of 10.9 GB (26%)
21:49:58.433 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 2.9 GB of 10.9 GB (26%)
21:50:03.435 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.0 GB of 10.9 GB (27%)
21:50:08.436 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.1 GB of 10.9 GB (28%)
21:50:13.436 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.1 GB of 10.9 GB (28%)
21:50:18.437 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.2 GB of 10.9 GB (29%)
21:50:23.438 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.3 GB of 10.9 GB (29%)
21:50:28.439 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.3 GB of 10.9 GB (30%)
21:50:33.440 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.4 GB of 10.9 GB (31%)
21:50:38.440 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.5 GB of 10.9 GB (31%)
21:50:43.441 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.5 GB of 10.9 GB (32%)
21:50:48.443 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.6 GB of 10.9 GB (32%)
21:50:57.702 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.6 GB of 10.9 GB (33%)
21:51:02.703 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.7 GB of 10.9 GB (34%)
21:51:07.705 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.8 GB of 10.9 GB (34%)
21:51:12.706 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.9 GB of 10.9 GB (35%)
21:51:17.708 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 3.9 GB of 10.9 GB (35%)
21:51:22.709 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.0 GB of 10.9 GB (36%)
21:51:27.710 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.1 GB of 10.9 GB (37%)
21:51:32.710 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.1 GB of 10.9 GB (37%)
21:51:37.712 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.2 GB of 10.9 GB (38%)
21:51:56.199 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.3 GB of 10.9 GB (38%)
21:52:01.198 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.3 GB of 10.9 GB (39%)
21:52:06.199 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.4 GB of 10.9 GB (40%)
21:52:11.200 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.5 GB of 10.9 GB (41%)
21:52:16.202 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.5 GB of 10.9 GB (41%)
21:52:21.204 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.6 GB of 10.9 GB (42%)
21:52:26.205 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.7 GB of 10.9 GB (42%)
21:52:31.205 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.8 GB of 10.9 GB (43%)
21:52:36.207 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.8 GB of 10.9 GB (44%)
21:52:41.209 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 4.9 GB of 10.9 GB (44%)
21:52:46.212 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.0 GB of 10.9 GB (45%)
21:52:51.213 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.1 GB of 10.9 GB (46%)
21:52:56.215 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.1 GB of 10.9 GB (46%)
21:53:01.217 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.2 GB of 10.9 GB (47%)
21:53:06.218 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.3 GB of 10.9 GB (48%)
21:53:11.220 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.3 GB of 10.9 GB (48%)
21:53:16.220 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.4 GB of 10.9 GB (49%)
21:53:21.223 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.5 GB of 10.9 GB (50%)
21:53:26.223 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.5 GB of 10.9 GB (50%)
21:53:31.225 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.6 GB of 10.9 GB (51%)
21:53:36.227 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.7 GB of 10.9 GB (51%)
21:53:41.228 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.7 GB of 10.9 GB (52%)
21:53:46.230 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.8 GB of 10.9 GB (53%)
21:53:51.232 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.9 GB of 10.9 GB (53%)
21:53:56.233 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 5.9 GB of 10.9 GB (54%)
21:54:01.233 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.0 GB of 10.9 GB (54%)
21:54:06.236 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.1 GB of 10.9 GB (55%)
21:54:11.237 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.1 GB of 10.9 GB (56%)
21:54:16.237 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.2 GB of 10.9 GB (56%)
21:54:21.238 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.2 GB of 10.9 GB (57%)
21:54:26.241 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.3 GB of 10.9 GB (57%)
21:54:31.241 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.3 GB of 10.9 GB (58%)
21:54:36.285 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.4 GB of 10.9 GB (58%)
21:54:41.286 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.4 GB of 10.9 GB (58%)
21:54:56.803 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.5 GB of 10.9 GB (59%)
21:55:11.918 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.5 GB of 10.9 GB (59%)
21:55:26.884 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.5 GB of 10.9 GB (59%)
21:55:41.373 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.5 GB of 10.9 GB (59%)
21:55:56.481 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.5 GB of 10.9 GB (59%)
21:56:10.768 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:56:25.189 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:56:39.399 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:56:53.545 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:57:07.618 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:57:21.879 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:57:35.972 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:57:49.941 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:58:03.918 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:58:17.874 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.6 GB of 10.9 GB (60%)
21:58:31.862 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:58:45.239 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:58:58.625 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:59:12.024 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:59:25.403 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:59:38.773 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
21:59:52.186 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
22:00:05.561 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
22:00:18.961 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (60%)
22:00:32.337 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:00:45.698 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:00:59.070 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:01:12.439 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:01:25.824 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:01:39.212 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:01:52.577 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:02:05.934 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:02:19.314 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:02:32.707 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:02:46.074 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:02:59.475 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:03:12.879 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:03:26.253 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:03:39.660 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:03:53.058 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:04:06.644 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:04:20.051 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:04:33.450 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:04:47.043 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:05:00.405 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:05:13.809 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:05:27.200 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:05:40.602 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:05:54.132 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:06:07.573 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:06:21.092 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:06:34.618 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:06:48.024 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:07:01.555 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:07:15.080 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:07:28.461 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:07:42.026 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:07:55.567 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:08:08.956 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:08:22.328 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:08:35.856 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:08:49.220 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:09:02.588 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:09:15.932 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:09:29.286 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:09:42.658 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:09:56.042 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:10:09.539 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:10:22.769 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:10:36.145 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:10:49.515 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:11:02.870 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:11:16.235 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:11:29.803 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:11:43.133 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:11:57.520 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:12:11.375 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:12:24.736 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:12:38.090 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:12:52.083 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:13:06.144 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:13:20.190 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:13:34.541 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:13:48.400 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:14:02.483 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:14:15.840 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:14:29.398 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:14:42.633 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:14:56.541 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:15:09.800 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:15:23.611 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:15:37.239 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:15:50.585 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:16:04.006 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:16:17.348 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:16:30.567 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:16:44.101 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:16:57.318 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:17:10.649 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:17:24.195 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:17:38.197 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:17:51.460 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:18:04.825 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:18:18.094 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:18:31.472 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:18:44.690 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:18:58.043 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:19:11.262 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:19:24.668 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:19:37.899 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:19:51.239 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:20:04.473 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:20:17.838 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:20:31.133 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:20:44.481 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:20:57.716 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:21:11.274 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:21:24.520 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:21:37.922 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:21:51.349 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:22:04.701 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:22:17.937 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:22:31.441 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:22:44.689 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:22:58.041 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:23:11.466 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:23:24.860 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:23:38.086 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:23:51.621 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:24:04.844 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:24:18.213 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:24:31.617 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:24:44.975 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:24:58.225 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:25:11.757 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:25:25.004 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:25:38.352 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:25:51.798 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:26:05.198 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:26:18.457 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)
22:26:32.001 INFO (OpenStreetMapProvider.java:115) Parse OSM Nodes progress: 6.7 GB of 10.9 GB (61%)

Expected behavior

It finished building the graph object

Observed behavior

It stalls part way through building the graph

Version of OTP used (exact commit hash or JAR name)

otp-2.2.0-shaded.jar
This is necessary because the latest version is not supported on Debian Bookworm:

java.lang.UnsupportedClassVersionError: org/opentripplanner/standalone/OTPMain has been compiled by a more recent version of the Java Runtime (class file version 65.0), this version of the Java Runtime only recognizes class file versions up to 61.0

Data sets in use (links to GTFS and OSM PBF files)

us-latest.osm.pbf: https://download.geofabrik.de/north-america/us-latest.osm.pbf

Command line used to start OTP

java -Xmx80G -jar ./otp-2.2.0-shaded.jar --build --save ./open_trip_planner/

Router config and graph build config JSON

There is no configuration file. I simply dropped the us-latest.osm.pbf in the open_trip_planner folder.

Steps to reproduce the problem

All necessary information has already been given.

[AdamWelch1]

It finally aborted with an out of memory error at 6.8Gb. It's kind of crazy that 80Gb of RAM isn't enough to process a 10.9Gb file, but I guess it's not?

[t2gran]

The pbf file is optimized to save space, so when mapped into objects in memory it takes a lot more space. I have not measured it, so I can not give you any numbers. You may also consider using something with Java 21 and OTP v2.6 - not sure if it helps. Another option is to use a tool like osmium to crop the pbf file to the area you want:

osmium extract --overwrite -v -b <bbox> us-latest.osm.pbf -o temp.osm.pbf
osmium tags-filter temp.osm.pbf w/highway w/public_transport=platform w/railway=platform w/park_ride r/type=restriction -o  

Also, if you need to run OTP for the entire US then you are doing something OTP is not designed for. We keep scaling OTP up, but you must expect to invest resources to do so.