Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Food products parquet not generated since 20 days #28

Open
alexgarel opened this issue Feb 24, 2025 · 0 comments
Open

Food products parquet not generated since 20 days #28

alexgarel opened this issue Feb 24, 2025 · 0 comments
Labels

Comments

@alexgarel
Copy link
Member

In the logs:

2025-02-24 17:46:49,499 :: ERROR :: [Job 1db395d4-4bd5-4f3f-b40d-10e6e4e9099d]: exception raised while executing (openfoodfacts_exports.exports.parquet.export_parquet)
Traceback (most recent call last):
File "/app/.venv/lib/python3.12/site-packages/rq/worker.py", line 1573, in perform_job
rv = job.perform()
^^^^^^^^^^^^^
File "/app/.venv/lib/python3.12/site-packages/rq/job.py", line 1322, in perform
self._result = self._execute()
^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.12/site-packages/rq/job.py", line 1356, in _execute
result = self.func(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/openfoodfacts_exports/exports/parquet/init.py", line 57, in export_parquet
convert_jsonl_to_parquet(
File "/app/openfoodfacts_exports/exports/parquet/init.py", line 114, in convert_jsonl_to_parquet
products = [pydantic_cls(**item).model_dump(by_alias=True) for item in batch]
^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.12/site-packages/pydantic/main.py", line 212, in init
validated_self = self.pydantic_validator.validate_python(data, self_instance=self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pydantic_core._pydantic_core.ValidationError: 1 validation error for FoodProduct
nova_groups
Input should be a valid string [type=string_type, input_value=1, input_type=int]
For further information visit https://errors.pydantic.dev/2.9/v/string_type

2025-02-24 17:46:50,222 :: INFO :: Cleaning registries for queue: off-exports-high

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant