Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate nutrition extraction model #1418

Open
raphael0202 opened this issue Sep 19, 2024 · 1 comment
Open

Integrate nutrition extraction model #1418

raphael0202 opened this issue Sep 19, 2024 · 1 comment

Comments

@raphael0202
Copy link
Collaborator

Problem

A LayoutLMv3 model was fined-tuned on the nutrition extraction dataset: https://huggingface.co/openfoodfacts/nutrition-extractor.
Integrate it in production, by:

  • exporting it to ONNX (using optimum library)
  • integrating to Robotoff
@teolemon
Copy link
Member

One nice thing would be Robotoff writing a data quality tag whenever the detected values and the actual values don't match (typically outdated images where the contributor hasn't updated the values.)
We could then flag false positives using Nutri-Patrol

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

2 participants