You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We need to verify that the DomainDB and UrlDB states are checkpointed/savepointed properly.
For checkpointing, we need a test that enables checkpointing (in memory), causes the job to fail, and the verifies that we don't replay everything that we've processed (so checkpointing worked).
For savepointing, I think we need a test that stops a job, then restarts with a different parallelism, and verifies that state is re-distributed properly.
The text was updated successfully, but these errors were encountered:
We need to verify that the DomainDB and UrlDB states are checkpointed/savepointed properly.
For checkpointing, we need a test that enables checkpointing (in memory), causes the job to fail, and the verifies that we don't replay everything that we've processed (so checkpointing worked).
For savepointing, I think we need a test that stops a job, then restarts with a different parallelism, and verifies that state is re-distributed properly.
The text was updated successfully, but these errors were encountered: