-
Notifications
You must be signed in to change notification settings - Fork 538
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Snapshot save error #228
Comments
hi @uber42 , thanks for reporting the above issue. Could you please confirm what filesystem was used? It is a local file system or some networked file system like NFS? |
hi, I use ext4 |
@uber42 thanks for the info. As you can see from the error log -
the dir "/home/user/repos/storage-69397425/3/raft/dev/00000000000000000001/snapshot-part-1/snapshot-1-3" is missing when a new snapshot is about to be created inside it. this dir is created when the node is started in NodeHost.startCluster(). I don't think there is any code that would delete the dir. any chance that it might be deleted by some of your code? |
The root raft directory cannot be deleted by our code. |
@uber42 thanks for the info. I have the feeling that this issue is highly unlikely to be caused by Dragonboat's code. If you check the source code, node's snapshot dir is never deleted, dragonboat only deletes whats in the directory. Large scale fault injection tests are a part of dragonboat's development process for years, it was fine in all those tests. Could you please try to re-run your tests and provide the full log when you can reproduce the issue? Really want to help you to get to the bottom of this. Thanks. |
I will try to reproduce, but so far this is an isolated case for a very large number of tests. |
@uber42 did you manage to get this reproduced? |
Dragonboat version
v3.3.1
Steps to reproduce the behavior
Couldn't reproduce again
The text was updated successfully, but these errors were encountered: