Skip to content
This repository has been archived by the owner on Oct 4, 2024. It is now read-only.

Full library not indexed? #262

Closed
milan187 opened this issue Sep 29, 2020 · 11 comments
Closed

Full library not indexed? #262

milan187 opened this issue Sep 29, 2020 · 11 comments

Comments

@milan187
Copy link

Hello I have a large library of 150,000 photos.

I just setup gphotos-sync on Synology NAS as a container.

image

Tried to search but did not find anything.
Bug or am I missing something?

@gilesknap
Copy link
Owner

Sorry for late reply. We have seen bugs in Google API that cause this kind of behaviour.

Are you syncing albums? Some libraries don't index all photos through raw index but then can find them in albums (this is a Google bug). Are you using library sharing? This can cause confusing results. Do you archive photos? If so then you need to tell gphotos-sync to sync archived items.

@milan187
Copy link
Author

milan187 commented Oct 4, 2020

No worries. Thanks for reply. I'm pretty new to using this. Thank you for working on it.

What I've noticed it that in the albums folder I see a bunch of albums but all the folders are empty. I don't necessarly use the albums, most of them are auto created. I do use a shared library with my wife. So I'm not sure if that is causing the issue. Do not use archive but it may have some photos in there like screenshot I don't care about.

My only command right now is /storage

How else can I approach this in terms of command to see if it will sync everything. Again I don't care about albums/archive but would like photos that are shared of kids from my wife to sync.

@gilesknap
Copy link
Owner

gilesknap commented Oct 6, 2020 via email

@wuhuwuhuhu
Copy link

I also use gphotos-sync on Synology NAS as a container. And I have the same problem. I think it's something wrong in the docker.

@milan187
Copy link
Author

I also use gphotos-sync on Synology NAS as a container. And I have the same problem. I think it's something wrong in the docker.

How are you comparing the numbers? I found out Google dashboard is wrong.

@wuhuwuhuhu
Copy link

The number is the same as the dashboard. Even when I use Python to run gphotos-sync. But when I use Google takeout, it told me I have about 800G photos in GooglePhoto, rather than 150G downloaded by gphotos-sync. I think this should be blamed on APIs. I am not sure the real number, I will use takeout to get all my photos.

@gilesknap
Copy link
Owner

@wuhuwuhuhu discrepancy in disk space is easily explained I'm afraid all the videos downloaded are trans-coded to a higher compression and much smaller file. This is loss of data. We have a long standing bug in with Google on this see #119

@milan187
Copy link
Author

I noticed something else. As mentioned I have a shared library with wife.
I have an S20, she has Pixel 3.

All her videos get downloaded to my sync but not mine.
Weird, any idea?

Otherwise I think I have everything.

@gilesknap
Copy link
Owner

Hi sorry for the long delay. If you are still having the missing video issue and would like to try debugging it then let me know. We would need to set up some tracing and take a look through your logs. I'm afraid that this sounds similar to other issues that have turned out to be caused by these Google bugs from #119 which they do not seem to be very receptive to fixing:
https://issuetracker.google.com/issues/151032572
https://issuetracker.google.com/issues/129250413

@Alives
Copy link

Alives commented Jan 26, 2022

I just started using gphotos-sync and I think I ran into this issue. While doing the original download I was watching the archive size and file download count, but ran out of quota. After waiting 24hrs I ran it again, it continued to download, but then at the end it seems to have removed all shared content that was not originally mine. Regardless of flags I throw at it or number of attempts, I cannot get it to sync any shared content. I've blown away the db, removed all gphotos.* files and had it re-create them, no dice.

I can verify that it's missing shared content by looking at a shared album from the photos.google.com website and finding a photo from someone else, looking at the filename and looking for that filename in my archive.

How can I help debug this? I'm running with: --do-delete --flush-index --retry-download --archived

@gilesknap
Copy link
Owner

I'm releasing a new version of gphotos-sync and closing stale issues. Please reopen if you still want me to look at this. Thanks.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants