Skip to content
This repository has been archived by the owner on May 29, 2020. It is now read-only.

Somehow preserve S3 metadata across calls #1

Open
EdSchouten opened this issue Sep 15, 2016 · 0 comments
Open

Somehow preserve S3 metadata across calls #1

EdSchouten opened this issue Sep 15, 2016 · 0 comments

Comments

@EdSchouten
Copy link
Contributor

The awssyncer will inherently need to do a full synchronisation every couple of hours. The reason for this is that inotify may easily miss events in our case. For example, in case files are hardlinked, we'll only receive a single event for one of the paths.

Still, there is room for improving the number of requests we send over to S3. If we would cache the state of S3 across calls, we'd know exactly what to sync and what can be skipped.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant