Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data dump is not available anymore #407

Closed
raphael0202 opened this issue Aug 29, 2024 · 4 comments · Fixed by #461 or #507
Closed

Data dump is not available anymore #407

raphael0202 opened this issue Aug 29, 2024 · 4 comments · Fixed by #461 or #507
Labels
🐛 Bug Something isn't working Data exports

Comments

@raphael0202
Copy link
Contributor

The DB dump is not available anymore on https://prices.openfoodfacts.net/data/prices.jsonl.gz

@raphodn
Copy link
Member

raphodn commented Sep 23, 2024

Error is [Errno 2] No such file or directory: '/...static/data/prices.jsonl.gz'

@raphodn raphodn linked a pull request Sep 23, 2024 that will close this issue
@github-project-automation github-project-automation bot moved this from Backlog to Done in 💸 Open Prices Sep 23, 2024
@raphodn raphodn reopened this Sep 23, 2024
@github-project-automation github-project-automation bot moved this from Done to Ready in 💸 Open Prices Sep 23, 2024
@raphodn
Copy link
Member

raphodn commented Sep 23, 2024

I tested on staging, the dump command now works.
The 3 jsonl.gz backup files are stored in /static/data

But going to the above links returns a 404. Probably an issue with nginx ?
And maybe also not the correct place to store the backup files ?

@raphael0202
Copy link
Contributor Author

You should output the dump files in /opt/open-prices/data (within the container).
I've created a fake JSON file at /opt/open-prices/data/1.json, and it's served correctly at https://prices.openfoodfacts.net/data/1.json

@raphodn
Copy link
Member

raphodn commented Oct 9, 2024

I did a quick test

docker exec -it open_prices-api-1 bash
cd static/data/
ls -ah
cp prices.jsonl.gz /opt/open-prices/data/
cp locations.jsonl.gz /opt/open-prices/data/
cp proofs.jsonl.gz /opt/open-prices/data/

and indeed it works :)

@raphodn raphodn closed this as completed in 97ed9b2 Oct 9, 2024
@github-project-automation github-project-automation bot moved this from Ready to Done in 💸 Open Prices Oct 9, 2024
@raphodn raphodn added the 🐛 Bug Something isn't working label Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Something isn't working Data exports
Projects
Status: Done
3 participants