Parallel state processor failed err="invalid merkle root ..."

[donbeave]

I'm getting this warning in running bor instance, it looks like synchronization is still in progress.

I'm not sure if is it an error that I should take care of or if I just can ignore it.

INFO [02-20|22:47:22.301] Starting peer-to-peer node               instance=bor/v2.0.0/linux-amd64/go1.23.6
...

INFO [02-20|22:47:22.345] New local node record                    seq=1,739,807,990,912 id=8ccea65000e07cf9 ip=162.55.230.100 udp=30305 tcp=30305
INFO [02-20|22:47:22.353] Started P2P networking                   self=enode://fc86e49fc965a284679060bff9cd1acea99e1c89398dacfa0f39aa4da224cd29ab8e92cb41d117432af7aae6a82fd9f3cd4f117f83da1da508b125f6b5986481@162.55.230.100:30305
INFO [02-20|22:47:22.355] IPC endpoint opened                      url=/data/bor/bor.ipc
WARN [02-20|22:47:22.355] Sanitizing invalid HTTP read header timeout provided=0s      updated=30s
INFO [02-20|22:47:22.355] HTTP server started                      endpoint=[::]:8945 auth=false prefix= cors=* vhosts=*
INFO [02-20|22:47:22.358] Whitelisting milestone deferred          err="chain out of sync"
INFO [02-20|22:47:22.359] Whitelisting checkpoint deferred         err="chain out of sync"
INFO [02-20|22:47:31.325] Block synchronisation started
WARN [02-20|22:47:32.323] Parallel state processor failed          err="invalid merkle root (remote: 9d56272b9da021d19eb12f4305ba9528fb1e7ef2da47cb7fb6dfe06ee89452de local: c6ad6091b8bdd035b77f9d581f6dfceb47e166e9abcec6484a8ba4fca9ddbead) dberr: %!w(<nil>)"
INFO [02-20|22:47:32.536] Imported new chain segment               number=15,777,208 hash=2280dc..422fce blocks=2 txs=617 mgas=42.401 elapsed=480.797ms mgasps=88.189 age=3y8mo3w snapdiffs=4.87MiB triediffs=139.96MiB triedirty=187.63MiB
INFO [02-20|22:47:32.938] Imported new chain segment               number=15,777,210 hash=29c210..09847d blocks=2 txs=773 mgas=42.437 elapsed=401.911ms mgasps=105.589 age=3y8mo3w snapdiffs=4.93MiB triediffs=139.76MiB triedirty=187.68MiB
INFO [02-20|22:47:34.363] Whitelisting milestone deferred          err="chain out of sync"
INFO [02-20|22:47:46.362] Whitelisting milestone deferred          err="chain out of sync"
WARN [02-20|22:47:54.562] Served eth_coinbase                      conn=194.67.206.50:43494 reqid=2 duration="15.55µs" err="the method eth_coinbase does not exist/is not available"
INFO [02-20|22:47:58.362] Whitelisting milestone deferred          err="chain out of sync"
INFO [02-20|22:48:10.363] Whitelisting milestone deferred          err="chain out of sync"
INFO [02-20|22:48:22.362] Whitelisting milestone deferred          err="chain out of sync"
ERROR[02-20|22:48:31.914] Expired request does not exist           peer=83570f7405cf005e8cde20f99b69a935945b0af25448d95a4355e6f3a5a02b10
INFO [02-20|22:48:33.228] Fetching state updates from Heimdall     fromID=424,668 to=2021-06-16T09:19:47Z
INFO [02-20|22:48:33.228] Fetching state sync events               queryParams="from-id=424668&to-time=1623835187&limit=50"
INFO [02-20|22:48:33.242] "→ committing new state"               eventRecord=424,668
INFO [02-20|22:48:33.244] "→ committed new state"                eventRecord="id 424668, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000be958864291682f6fb1884455722bd483fa33c26000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000038184fe5, txHash: 0xeff66a14aaf688308cce3b9c39fed45afcb4e287cb0705a62a0b0be5f5584f19, logIndex: 149, chainId: 137, time 2021-06-16T09:19:09Z, gasUsed 54139"
INFO [02-20|22:48:33.244] "→ committing new state"               eventRecord=424,669
INFO [02-20|22:48:33.244] "→ committed new state"                eventRecord="id 424669, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000840ea78f667b73853f4baece4a5ebe212c4039c1000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000004d9c77be95, txHash: 0x317ae025cb309f4bf24aab5ff5c61ac1f1188146b5ba1f5ec2aa4ee4380b310b, logIndex: 180, chainId: 137, time 2021-06-16T09:19:09Z, gasUsed 24539"
INFO [02-20|22:48:33.244] "→ committing new state"               eventRecord=424,670
INFO [02-20|22:48:33.246] "→ committed new state"                eventRecord="id 424670, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000003d4517883b0212953e5136d2e261321b59158c85000000000000000000000000dac17f958d2ee523a2206206994597c13d831ec7000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000754f989f8, txHash: 0x48128e4e5193803dbb8183841b4cf146e8be625d953e2888edbdee80f758b80f, logIndex: 275, chainId: 137, time 2021-06-16T09:19:09Z, gasUsed 57839"
INFO [02-20|22:48:33.246] "→ committing new state"               eventRecord=424,671
INFO [02-20|22:48:33.246] "→ committed new state"                eventRecord="id 424671, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a000000000000000000000000005a14dbc97b5fdfc39f09a9c81acf6a3d748428f000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb480000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000241cbe60, txHash: 0x3326e06584c4d00b1f5845728e74265e0258d79c65a748779007637852df91d0, logIndex: 353, chainId: 137, time 2021-06-16T09:19:09Z, gasUsed 41639"
INFO [02-20|22:48:33.246] "→ committing new state"               eventRecord=424,672
INFO [02-20|22:48:33.249] "→ committed new state"                eventRecord="id 424672, contract 0xD9c7C4ED4B66858301D0cb28Cc88bf655Fe34861, data: 0x000000000000000000000000f27474cb9bb9419fcf80ca93ee01c449102ec4d10000000000000000000000007d1afa7b718fb893db30a3abc0cfc608aacfebb00000000000000000000000000000000000000000000000039c3eeeb97aea280000000000000000000000000000000000000000000000000000000000085ad336, txHash: 0x6709ee61d5964058d8ab9945ba7e9789a59f0f9ccec4dc38d1c535c8ce95a278, logIndex: 144, chainId: 137, time 2021-06-16T09:19:39Z, gasUsed 70088"
INFO [02-20|22:48:33.249] "→ committing new state"               eventRecord=424,673
INFO [02-20|22:48:33.250] "→ committed new state"                eventRecord="id 424673, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000ed8454aab37befc3ee0f73ccf4c50b742edecefb0000000000000000000000002260fac5e5542a773aa44fbcfedf7c193bc2c5990000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000004b6fd1, txHash: 0x074d3221b3781361027bedcbcbd8ce9bce424e3a325d84d97e18b0afe5b9196b, logIndex: 260, chainId: 137, time 2021-06-16T09:19:39Z, gasUsed 38239"
INFO [02-20|22:48:33.250] "→ committing new state"               eventRecord=424,674
INFO [02-20|22:48:33.250] "→ committed new state"                eventRecord="id 424674, contract 0xD9c7C4ED4B66858301D0cb28Cc88bf655Fe34861, data: 0x0000000000000000000000004d3c1c2d507fe2701febf0133641aa3f3a37266a0000000000000000000000007d1afa7b718fb893db30a3abc0cfc608aacfebb0000000000000000000000000000000000000000000000005e06fac32d3049b5e00000000000000000000000000000000000000000000000000000000085ad337, txHash: 0x3f013612a9c93741cd5eaf7d22aa4646d683f265d4810207e1b527b2c4881220, logIndex: 121, chainId: 137, time 2021-06-16T09:19:39Z, gasUsed 75186"
INFO [02-20|22:48:33.250] StateSyncData                            gas=361,669 number=15,777,216 lastStateID=424,674 "total records"=7 "fetch time"=14 "process time"=8
INFO [02-20|22:48:34.366] Whitelisting milestone deferred          err="chain out of sync"
WARN [02-20|22:48:34.807] Parallel state processor failed          err="invalid merkle root (remote: 88fd9c1c83079842bf63d1fd57769f9269e11150d15ef8f12490f81a374ca738 local: f65523b78ef58d4e487880332d0548b9cf74cee695666b2c63114ed1fbfa09ee) dberr: %!w(<nil>)"
WARN [02-20|22:48:36.307] Parallel state processor failed          err="invalid merkle root (remote: d472b373b10357ef6ff92d64d3db622910894b275117a65f8b4e7b86782603eb local: dd23ab7724419031fb55d663342820d250b3b950eb915e8f8c9d3f753bdc5d15) dberr: %!w(<nil>)"
INFO [02-20|22:48:40.022] Imported new chain segment               number=15,777,252 hash=687d64..5fab11 blocks=42 txs=11589 mgas=858.028 elapsed=8.097s    mgasps=105.963 age=3y8mo3w snapdiffs=6.50MiB triediffs=145.90MiB triedirty=188.22MiB
INFO [02-20|22:48:44.461] Fetching state updates from Heimdall     fromID=424,675 to=2021-06-16T09:24:05Z
INFO [02-20|22:48:44.461] Fetching state sync events               queryParams="from-id=424675&to-time=1623835445&limit=50"
INFO [02-20|22:48:44.531] "→ committing new state"               eventRecord=424,675
INFO [02-20|22:48:44.532] "→ committed new state"                eventRecord="id 424675, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000004be70f47a39eac265a5ccb6080c01b0ba82434c7000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee00000000000000000000000000000000000000000000000000000000000000600000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000002aa1efb94e0000, txHash: 0x95f304470cd207941d8a6106f0d1ba42461463aa84247905f7adc59bb09472f0, logIndex: 228, chainId: 137, time 2021-06-16T09:20:10Z, gasUsed 66270"
INFO [02-20|22:48:44.532] "→ committing new state"               eventRecord=424,676
INFO [02-20|22:48:44.533] "→ committed new state"                eventRecord="id 424676, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000004ad185bb58238573cf1e739641b5d8c6cfb944a7000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee00000000000000000000000000000000000000000000000000000000000000600000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000016345785d8a0000, txHash: 0xfb254a4702c751dba48b1e1a2451bece30e72c6bca7cc5632edd09daf101d0f1, logIndex: 104, chainId: 137, time 2021-06-16T09:20:10Z, gasUsed 41068"
INFO [02-20|22:48:44.533] "→ committing new state"               eventRecord=424,677
INFO [02-20|22:48:44.533] "→ committed new state"                eventRecord="id 424677, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000d956dd349bb158b390e6bc4abd73faebd8194708000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee0000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000107ad8f556c6c0000, txHash: 0xc94247f0fd6efba82865994a0e34865e9948dfd46bf120955ee25d789f81e00f, logIndex: 134, chainId: 137, time 2021-06-16T09:20:10Z, gasUsed 41170"
INFO [02-20|22:48:44.533] "→ committing new state"               eventRecord=424,678
INFO [02-20|22:48:44.534] "→ committed new state"                eventRecord="id 424678, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000abe1a48d2c17f18451cf2c7d5f807425bce4f92b000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000004563918244f40000, txHash: 0x2843bc256d1ca870085958b1c900a8dc12bfd1322af3997ccb4a6593be7f70de, logIndex: 138, chainId: 137, time 2021-06-16T09:20:10Z, gasUsed 41170"

[cffls]

Thanks for reporting this issue @donbeave . You can just ignore it as long as the node is able to continue syncing. The warning message indicated the parallel execution computed a different merkle root from what the block header had. The serial execution (a concurrent process) succeeded so the node was able to continue syncing. We will be looking into this.

[GaryNodies]

Hi, I’m also encountering the Parallel state processor failed issue while syncing my Bor instance. It would sync for a while, then throw out a bunch of those warnings, then keep syncing. Is this still a known issue, and can it be safely ignored?

INFO [03-03|14:51:51.085] "→ committed new state"                eventRecord="id 771845, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000002eaf27f0c2ac07ebe5bccdc972377124f5100756000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000accdd281e000, txHash: 0x1044dc672b50281a88f15adc43754ddfed831622fad1f64b458090d546d73bd7, logIndex: 317, chainId: 137, time 2021-09-03T08:55:39Z, gasUsed 41170"
INFO [03-03|14:51:51.085] StateSyncData                            gas=565,837    number=18,695,680 lastStateID=771,845 "total records"=14  "fetch time"=3    "process time"=2
WARN [03-03|14:51:51.086] Parallel state processor failed          err="invalid merkle root (remote: 7673ef2e2d2884916dc4cd4e71380ad5592dabac510d84c6fd38eca684d389e1 local: 1db1359f259cdf87c69c7be87a5b4955089740a48eba15c9adecf3a2cda4932b) dberr: %!w(<nil>)"
WARN [03-03|14:51:51.265] Parallel state processor failed          err="invalid merkle root (remote: 0fa478eecc91ac21e64ecb2eaf2970989105e1552ab16bbd05474c2db72d3326 local: 34b34a047db08d4201dd2a76a7089a0e3b64cb9182aa543b3b2fd07978a94b76) dberr: %!w(<nil>)"
WARN [03-03|14:51:51.357] Parallel state processor failed          err="invalid merkle root (remote: b309b8ddcb38992a21adc49174dc751f61387667734c071e314926419406af1f local: 12942ff422b4a1b5546a8bf0852cd38e0f36973cf0617570808046ee93e2af53) dberr: %!w(<nil>)"
WARN [03-03|14:51:51.545] Parallel state processor failed          err="invalid merkle root (remote: dd76d21a9aa88ce553b15a9c76ad70c25220f79ff3dd5f23c9ae312c51ce7410 local: 79725013ac2d3d7ade2648313eda677ed7e50526ad93819db8e655ec2ca1d872) dberr: %!w(<nil>)"
WARN [03-03|14:51:51.633] Parallel state processor failed          err="invalid merkle root (remote: 5362b318d0dc55f572d2e649a7dc8da8089d5903f36a673725f60e84100870b6 local: 8be8771c79ec380cfbf73425e876632b4a1df95702fb1921f7c1bff0d6df83e8) dberr: %!w(<nil>)"
WARN [03-03|14:51:52.366] Parallel state processor failed          err="invalid merkle root (remote: 4380ecf014364f8bb7454f7530e55b6a16391b7591dd521c1121857ca4775b99 local: 8dc6caa9ccd07e1acadf67eb062eac98a07c80fc9fafd8c725e5764efffb9f25) dberr: %!w(<nil>)"
WARN [03-03|14:51:52.438] Parallel state processor failed          err="invalid merkle root (remote: f19a4cb6cd9335f3fc46449d6d005c0d05b9d96fe68cc277d92d56ec47d444d7 local: 37e766f6274309203b85859d87cb51f596333f7b095883c0f350b96bff380ad9) dberr: %!w(<nil>)"
INFO [03-03|14:51:52.455] Imported new chain segment               number=18,695,695 hash=242f44..1f04f3 blocks=83   txs=16957   mgas=1656.814 elapsed=8.059s    mgasps=205.575 age=3y6mo2w   snapdiffs=8.24MiB    triediffs=173.36MiB triedirty=170.61MiB
WARN [03-03|14:51:55.176] Parallel state processor failed          err="invalid merkle root (remote: 19288cf6b308af9fd1c90a571035243e25d6e4c52c0f5b4f15de7350e1c2d686 local: 490c1368cdef1fa0fbcc665dfc8a82344587ec27167770ce44968ee2c1fb7646) dberr: %!w(<nil>)"
WARN [03-03|14:51:55.497] Parallel state processor failed          err="invalid merkle root (remote: d870a73af8829f93f95fb2d6efdaea3a006e0904ccffb25483ac4f065479383b local: 5501ced67bedf8b96fabd087f361b890be7864a00977fe63d88b466018b3c395) dberr: %!w(<nil>)"
WARN [03-03|14:51:55.579] Parallel state processor failed          err="invalid merkle root (remote: e5464da07e22037e0e48369818b6c06c8a8669fed34dd89b41c164e14e0ef825 local: d64421e779e224a872e136ab800e06d755f50a6653ba72a78515dd172a0009e7) dberr: %!w(<nil>)"
WARN [03-03|14:51:55.888] Parallel state processor failed          err="invalid merkle root (remote: ba85ed3280a989fd29ebf5d9395f7507c007cf483f4e1c17618745b3125dc1b5 local: 949f11fabe756fb08c995448ae9bb535d2f0570860cf91ffab44b41a24d884ff) dberr: %!w(<nil>)"
WARN [03-03|14:51:56.124] Parallel state processor failed          err="invalid merkle root (remote: 24026d431c2d0b9caa542ae7fb08ae719ce80b23e897c685d28011ccf9b9c276 local: 8c6b95c12b0a72edf236023c21e0303713db30a62b2d9e6a0869e5278f101e3a) dberr: %!w(<nil>)"
WARN [03-03|14:51:56.310] Parallel state processor failed          err="invalid merkle root (remote: c00e22e4c1d02435104bbfe13c8305b87548af2f9e7f6bc56e810bddf71b3962 local: 922d4594ff0e9a2d56464b3522ddf743f968a71b21f6941b80d25efbdd5e00e3) dberr: %!w(<nil>)"
WARN [03-03|14:51:56.404] Parallel state processor failed          err="invalid merkle root (remote: 811ee50e41e64f0946f3dfaf08d661ddb5f7e5e2fcece2a32763f4c323db52ff local: 44d68deaa0d4fa92bfaea520b2411cbcf4c853c556ca73fdf1d338c626a895f3) dberr: %!w(<nil>)"
WARN [03-03|14:51:56.626] Parallel state processor failed          err="invalid merkle root (remote: b8c80fc36a44cb202755c7f2c254a433645600587b28b82c35a03efb9aa400b9 local: ef0e0bb5f1bd9bafba392a71e450b05e2ce8b28f7bb39224533f735f9c54ac91) dberr: %!w(<nil>)"
WARN [03-03|14:51:56.875] Failed to fetch latest no-ack milestone  err="service unavailable: response code 503"
WARN [03-03|14:51:56.875] Failed to fetch latest milestone         err="service unavailable: response code 503"
WARN [03-03|14:51:57.084] Parallel state processor failed          err="invalid merkle root (remote: 54b5174a1d7ee42170f97bb0e68dfdbafee55039b9601d879e3e37f59b5f2ca5 local: bf422c27a4dde88b39729956dd4d44cb66a8632413e46f21098f70e7eecb36fd) dberr: %!w(<nil>)"
WARN [03-03|14:51:57.274] Parallel state processor failed          err="invalid merkle root (remote: 51bbe036d07eb2b27ee8955f184d19fcb804e99dcbd25df95d2a759c8866298c local: c3e375dcc708fc653154a56c5f9ca55a249d7eb247ab49af9b2ba8df250e69b9) dberr: %!w(<nil>)"
WARN [03-03|14:51:57.375] Parallel state processor failed          err="invalid merkle root (remote: f8c7b2e81cfdd1786388d9fe2d259b7510efc514527d8ec662e654b076d89aad local: 8bf6a912eed52dde4ce8f9c15683e6cdbcc349db156d9e543fb75fe3cbeeb761) dberr: %!w(<nil>)"
INFO [03-03|14:51:57.538] Fetching state updates from Heimdall     fromID=771,846 to=2021-09-03T08:58:02Z
INFO [03-03|14:51:57.538] Fetching state sync events               queryParams="from-id=771846&to-time=1630659482&limit=50"
INFO [03-03|14:51:57.546] "→ committing new state"               eventRecord=771,846
INFO [03-03|14:51:57.547] "→ committed new state"                eventRecord="id 771846, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000aac089a8924e422326ea69ee09e95065349a8aed000000000000000000000000d533a949740bb3306d119cc777fa900ba034cd5200000000000000000000000000000000000000000000000000000000000000600000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000bb2b730af5b18000, txHash: 0x79feca0ac04fee4524f6e460065e64a887aab0877c68239ada9ca2d78b3e203c, logIndex: 78, chainId: 137, time 2021-09-03T08:56:01Z, gasUsed 71515"
INFO [03-03|14:51:57.547] "→ committing new state"               eventRecord=771,847
INFO [03-03|14:51:57.547] "→ committed new state"                eventRecord="id 771847, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000299f881f71883cebe7d2e052fff9be1cc226566a000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee0000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000470de4df820000, txHash: 0x1b8d9c83f0408cb35b2e8d783345e3dc753691dd0663b4fadd73e18a0666f934, logIndex: 248, chainId: 137, time 2021-09-03T08:56:01Z, gasUsed 52470"
INFO [03-03|14:51:57.547] "→ committing new state"               eventRecord=771,848
INFO [03-03|14:51:57.548] "→ committed new state"                eventRecord="id 771848, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000efa6fc3c2ffb545cf18a5b4b1c6f3d5eff9d1317000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee0000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000ffcb9e57d40000, txHash: 0x0aee61c4378f3e227ed61272faa41894c48c67e6a60e909654429966dfe85658, logIndex: 437, chainId: 137, time 2021-09-03T08:56:36Z, gasUsed 41170"
INFO [03-03|14:51:57.548] "→ committing new state"               eventRecord=771,849
INFO [03-03|14:51:57.548] "→ committed new state"                eventRecord="id 771849, contract 0xD9c7C4ED4B66858301D0cb28Cc88bf655Fe34861, data: 0x000000000000000000000000ae6bc004ad3f7444668be955630fd9dfa4c98d870000000000000000000000007d1afa7b718fb893db30a3abc0cfc608aacfebb000000000000000000000000000000000000000000000034c2b7f411ba6ccb5e5000000000000000000000000000000000000000000000000000000000b38297a, txHash: 0x609db5ca62ede2086b0700ec909ea80cc3db96556ceeb80700eb5d572ea341ea, logIndex: 159, chainId: 137, time 2021-09-03T08:56:58Z, gasUsed 70088"
INFO [03-03|14:51:57.548] "→ committing new state"               eventRecord=771,850
INFO [03-03|14:51:57.549] "→ committed new state"                eventRecord="id 771850, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000002a254cc213af027954ca343656cf048f380514dd000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000092e88bffdcb1b7, txHash: 0xbb88cde9e8fe830e8d6ae159572c78bd1cedc4160fad83b217f89f34ba022832, logIndex: 197, chainId: 137, time 2021-09-03T08:57:34Z, gasUsed 41170"
INFO [03-03|14:51:57.549] StateSyncData                            gas=276,413    number=18,695,744 lastStateID=771,850 "total records"=5   "fetch time"=8    "process time"=2
INFO [03-03|14:51:57.556] Fetching state updates from Heimdall     fromID=771,846 to=2021-09-03T08:58:02Z
INFO [03-03|14:51:57.556] Fetching state sync events               queryParams="from-id=771846&to-time=1630659482&limit=50"
WARN [03-03|14:51:57.564] Parallel state processor failed          err="invalid merkle root (remote: d31bf540f43c1b5e9984e7cd3ae9c462001e33db070a04cf2bafa758938d47d2 local: 95ab75ea7a13e6adf18100e45dbc1fb239911cc980a3c683e2c6e0e38f48eb77) dberr: %!w(<nil>)"
INFO [03-03|14:51:57.576] "→ committing new state"               eventRecord=771,846
INFO [03-03|14:51:57.577] "→ committed new state"                eventRecord="id 771846, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000aac089a8924e422326ea69ee09e95065349a8aed000000000000000000000000d533a949740bb3306d119cc777fa900ba034cd5200000000000000000000000000000000000000000000000000000000000000600000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000bb2b730af5b18000, txHash: 0x79feca0ac04fee4524f6e460065e64a887aab0877c68239ada9ca2d78b3e203c, logIndex: 78, chainId: 137, time 2021-09-03T08:56:01Z, gasUsed 71515"
INFO [03-03|14:51:57.577] "→ committing new state"               eventRecord=771,847
INFO [03-03|14:51:57.577] "→ committed new state"                eventRecord="id 771847, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000299f881f71883cebe7d2e052fff9be1cc226566a000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee0000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000470de4df820000, txHash: 0x1b8d9c83f0408cb35b2e8d783345e3dc753691dd0663b4fadd73e18a0666f934, logIndex: 248, chainId: 137, time 2021-09-03T08:56:01Z, gasUsed 52470"
INFO [03-03|14:51:57.577] "→ committing new state"               eventRecord=771,848
INFO [03-03|14:51:57.577] "→ committed new state"                eventRecord="id 771848, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000efa6fc3c2ffb545cf18a5b4b1c6f3d5eff9d1317000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee0000000000000000000000000000000000000000000000000000000000000060000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000ffcb9e57d40000, txHash: 0x0aee61c4378f3e227ed61272faa41894c48c67e6a60e909654429966dfe85658, logIndex: 437, chainId: 137, time 2021-09-03T08:56:36Z, gasUsed 41170"
INFO [03-03|14:51:57.577] "→ committing new state"               eventRecord=771,849
INFO [03-03|14:51:57.578] "→ committed new state"                eventRecord="id 771849, contract 0xD9c7C4ED4B66858301D0cb28Cc88bf655Fe34861, data: 0x000000000000000000000000ae6bc004ad3f7444668be955630fd9dfa4c98d870000000000000000000000007d1afa7b718fb893db30a3abc0cfc608aacfebb000000000000000000000000000000000000000000000034c2b7f411ba6ccb5e5000000000000000000000000000000000000000000000000000000000b38297a, txHash: 0x609db5ca62ede2086b0700ec909ea80cc3db96556ceeb80700eb5d572ea341ea, logIndex: 159, chainId: 137, time 2021-09-03T08:56:58Z, gasUsed 70088"
INFO [03-03|14:51:57.578] "→ committing new state"               eventRecord=771,850
INFO [03-03|14:51:57.578] "→ committed new state"                eventRecord="id 771850, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a00000000000000000000000002a254cc213af027954ca343656cf048f380514dd000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee000000000000000000000000000000000000000000000000000000000000006000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000092e88bffdcb1b7, txHash: 0xbb88cde9e8fe830e8d6ae159572c78bd1cedc4160fad83b217f89f34ba022832, logIndex: 197, chainId: 137, time 2021-09-03T08:57:34Z, gasUsed 41170"
INFO [03-03|14:51:57.578] StateSyncData                            gas=276,413    number=18,695,744 lastStateID=771,850 "total records"=5   "fetch time"=19   "process time"=1
WARN [03-03|14:51:59.941] Parallel state processor failed          err="invalid merkle root (remote: c0c9be3d99bf9988411b568e385d8edab90a3c9244270151b0ce32c7971473f2 local: d7e6d1aea51cda172fc7f5917032c3c09dd310c3f999ebce74b98f1ea5acf175) dberr: %!w(<nil>)"
WARN [03-03|14:52:00.485] Parallel state processor failed          err="invalid merkle root (remote: 461c651699031e5f7a09ce3b7033c9ceb803c95e776601b3b04ef55cb390d429 local: 531282295fdafbbbe1641643ca8e7a1bb1714b84f0742b962e6b90e9f4cbc084) dberr: %!w(<nil>)"
INFO [03-03|14:52:00.501] Imported new chain segment               number=18,695,772 hash=df9cf9..38f177 blocks=77   txs=19751   mgas=1541.360 elapsed=8.045s    mgasps=191.584 age=3y6mo2w   snapdiffs=6.83MiB    triediffs=164.98MiB triedirty=178.22MiB
WARN [03-03|14:52:00.685] Parallel state processor failed          err="invalid merkle root (remote: 9b5a6c520ca997c45d91e0d0d75047db9d9e367179eef833d1e5f18185ced6fd local: 6b3efd81e1ba7732e55e2834eca5ef7bdda30a40215979805d66e7812bf171ba) dberr: %!w(<nil>)"
INFO [03-03|14:52:01.692] BurntContractAddress is in MVReadMap     address=0x0000000000000000000000000000000000000000
INFO [03-03|14:52:01.693] BurntContractAddress is in MVReadMap     address=0x0000000000000000000000000000000000000000
WARN [03-03|14:52:02.195] Parallel state processor failed          err="invalid merkle root (remote: 3c134b738bba0d2c8fd389838d606b402338795fe972b9016e99f530c3a9efad local: 087787574bf5e6594e0b9d1c656001acc70e26a926622e618b4fb2cf33301efd) dberr: %!w(<nil>)"
WARN [03-03|14:52:02.401] Parallel state processor failed          err="invalid merkle root (remote: e6832eb89e2799d439a7004371deb58414b40b3a4a0c13aca18ea0f14b9b1403 local: d1cf8a56568694e85cbb49fa11a62567ef08e32fdb0785f0cd614ac0139ee76e) dberr: %!w(<nil>)"
WARN [03-03|14:52:02.510] Parallel state processor failed          err="invalid merkle root (remote: ab0fcf2217a4b666418ccf268c1688f3c0376c9cdd0231c195857023a7c2c595 local: 7cf7a7a2e84aea558d76a6624489a89c867a25bea6f3d8bac38e52fc5fabebef) dberr: %!w(<nil>)"
WARN [03-03|14:52:02.888] Failed to fetch latest no-ack milestone  err="service unavailable: response code 503"
WARN [03-03|14:52:03.051] Parallel state processor failed          err="invalid merkle root (remote: 0182361a29c571cd5eced25c9c1d1ea97b2ed0384d591cc66adca60b1408ea38 local: d60dcb37486b388f24b42bb788ef46f8a45edfcf2be7715cb7a4212140cef6a0) dberr: %!w(<nil>)"
WARN [03-03|14:52:03.142] Parallel state processor failed          err="invalid merkle root (remote: 8964fb02e02e4101cb387e423c8e1b5e1784e8b61645bb31983605d3ca5400bc local: 363320697f2d7ddcb4f42b688a02f4d45241e15578755e21c6d68c3b37815798) dberr: %!w(<nil>)"
WARN [03-03|14:52:03.341] Parallel state processor failed          err="invalid merkle root (remote: b75c59a61f83537276ccdf69c242fd1d39b4fc80fc0f96dcc044b5feed3ffc2a local: 9b340b9255828de50c69b68ceca53aea8e32dc68445804fbc9efa1754f72b311) dberr: %!w(<nil>)"
WARN [03-03|14:52:03.489] Parallel state processor failed          err="invalid merkle root (remote: a1af2b46c74ac8ceb1044af2100bc01a841d6c8e6074140056e7ce5dd3a65a86 local: 88ccccb59f85243c676e016201d66a74e760fc5e152b9459f6f2e272e261f753) dberr: %!w(<nil>)"
INFO [03-03|14:52:03.857] Fetching state updates from Heimdall     fromID=771,851 to=2021-09-03T09:00:15Z
INFO [03-03|14:52:03.857] Fetching state sync events               queryParams="from-id=771851&to-time=1630659615&limit=50"
INFO [03-03|14:52:03.860] "→ committing new state"               eventRecord=771,851
INFO [03-03|14:52:03.861] "→ committed new state"                eventRecord="id 771851, contract 0xA6FA4fB5f76172d178d61B04b0ecd319C5d1C0aa, data: 0x87a7811f4bfedea3d341ad165680ae306b01aaeacc205d227629cf157dd9f821000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000a000000000000000000000000041248ab82f8ef99884352df3312fae03ea0cd850000000000000000000000000eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee00000000000000000000000000000000000000000000000000000000000000600000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000006a94d74f430000, txHash: 0xa33437fbf37fc66214e12c32988ddf51051aec1a90a7900a77fe2980307ded43, logIndex: 129, chainId: 137, time 2021-09-03T08:58:38Z, gasUsed 66270"
INFO [03-03|14:52:03.861] StateSyncData                            gas=66270      number=18,695,808 lastStateID=771,851 "total records"=1   "fetch time"=2    "process time"=0
INFO [03-03|14:52:03.861] Fetching state updates from Heimdall     fromID=771,851 to=2021-09-03T09:00:15Z
INFO [03-03|14:52:03.861] Fetching state sync events               queryParams="from-id=771851&to-time=1630659615&limit=50"