Improve ingredient parsing (tracker)

[teolemon]

What

• Break down this list into thematic sections

Improve parsing

Beta Give feedback

1. Non-vegan product marked as vegan #5249
   ⏰ Stale 🌱 Vegan 🎯 P1 🐛 bug 🥗🔍 Ingredients analysis 🧽 Data quality +6
2. Ingredients lists with missing spaces after dots are not parsed correctly, leading to false positives #4948
   facets ⏰ Stale 🥗 Ingredients 🥗🔍 Ingredients analysis +4
3. Parse 'with other natural flavouring' #4666
   ⏰ Stale 🥗🔍 Ingredients analysis +2
   
4. Make the list of non-vegan ingredients a tapeable list #6517
   Template::Toolkit 📖 Knowledge Panels 🤳🥫 mobile apps 🥗🔍 Ingredients analysis +4
5. Add a prompt to Taxonomy contribution in Ingredient Analysis sub-panel #6516
   Template::Toolkit non tech 📖 Knowledge Panels 🥗🔍 Ingredients analysis +4
6. Percentages as mg/kg not correctly parsed #6132
   ⏰ Stale 🥗🔍 Ingredients analysis +2
7. Limit percent max of some ingredients (e.g. aroma, ferments) (needed for milk estimate for Nutri-Score) #5369
   ✨ Feature 🚦 Nutri-Score 🚦Nutri-Score 🥗🔍 Ingredients analysis +4
   
8. Ingredients empty if ingredient text empty for main language #5546
   ⏰ Stale 🌍 Multilingual products 🐛 bug 🥗🔍 Ingredients analysis +4
   
9. Parsing of ingredient processing inside an ingredient. e.g. "leche entera pasteurisada de cabra" #5370
   ⏰ Stale 🥗🔍 Ingredients analysis +2
10. New field: precise / detailed ingredients list with exact quantity, origins and labels of all input ingredients in g instead of % #5199
    ⏰ Stale 🥗🔍 Ingredients analysis +2
11. Parse ingredients "with" (A with B, A processed with B etc.) #3065
    ⏰ Stale 🎯 P1 candidate 🥗 Ingredients 🥗🔍 Ingredients analysis +4
12. * value is nested to the last element of the parsed list #3833
    ⏰ Stale 🥗🔍 Ingredients analysis +2
13. Parsing en poudre after a (...) #3819
    ⏰ Stale 🥗🔍 Ingredients analysis +2
14. Add handling for "amount of product for each Xg/mL of product" #3642
    🐛 bug 🥗 Ingredients 🥗🔍 Ingredients analysis +3
    
15. Possibles traces parsing (Spanish): En esta fábrica se utilizan semillas de sésamo, pipas de girasol y frutos secos #3592
    Spanish Traces ⏰ Stale 🥗🔍 Ingredients analysis +4
16. Create an ingredients_origins structure from labels / origins like "French pork", "Cocoa from Ecuador" #4905
    ⏰ Stale 🌱 Eco-Score 📍 Origins 🥗🔍 Ingredients analysis +4
17. Recognize ingredient + origin (e.g. "lait origine France") in origins field, use it to attribute origin to ingredient #4461
    ⏰ Stale 🌱 Eco-Score 📍 Origins 🥗🔍 Ingredients analysis +4
18. Ingredient parsing: remove "ingredients" when it is the first word, even if there is no separator #3115
    🐛 bug 🥗 Ingredients 🥗🔍 Ingredients analysis +3
    
19. Ignore explanations at end of list of ingredients like ". *Organic Ingredients" #3030
    organic products 🐛 bug 🥗🔍 Ingredients analysis 🧽 Data quality +4
    
20. Ensure that (blé garanti sans gluten) doesn't create a false positive #944
    Tests - ToDo 🌾 gluten 🎯 P1 candidate 🥗 Ingredients 🥗🔍 Ingredients analysis 🧽 Data quality +6
21. Extract geographic origin when it is mentionned as a * #3392
    Tests - ToDo ⏰ Stale 📍 Origins 📍 location 🥗🔍 Ingredients analysis +5
22. Parse "Origin of [ingredient]: [country]" e.g. Origen de la leche: U.E. #3570
    Spanish ⏰ Stale 📍 Origins 🥗 Ingredients 🥗🔍 Ingredients analysis +5
23. Ensure that alcohol free beers do not trigger an alcohol warning #3405
    ⏰ Stale 🥗🔍 Ingredients analysis +2
24. Check that we output consistent types (string or float) for results of ingredients percent analysis #5376
    typing ⏰ Stale 🥗🔍 Ingredients analysis +3
25. Treat carriage returns as a comma for ingredient parsing #2867
    🥗 Ingredients 🥗🔍 Ingredients analysis 🧽 Data quality +3
26. Ingredient Parsing - "Wheatflour contains Gluten (...)" & "Farine de blé contient Gluten (...)" #4232
    ⏰ Stale 🌾 gluten 🥗🔍 Ingredients analysis +3
27. [ingredient parser] When ingredients are comma-separated, "-" (= "—") separates class from the ingredient #3909
    ⏰ Stale 🥗🔍 Ingredients analysis +2
28. Parse ingredient processing specified with a comma, after the ingredient #3905
    ⏰ Stale 🥗🔍 Ingredients analysis +2
    
29. Ingredients listed and joined by 'y' not separated when there is a * for the organic label #3738
    Spanish organic products ⏰ Stale 🥗 Ingredients 🥗🔍 Ingredients analysis +5
30. Short words in ingredients lists can cause a false match as an origin country #3432
    ⏰ Stale 📍 Origins 🥗🔍 Ingredients analysis +3
31. ingredient _X_Y not recognised #3960
    ⏰ Stale 🥗🔍 Ingredients analysis +2
32. Vitamin detection #3808
    vitamins ⏰ Stale 🥗🔍 Ingredients analysis +3
33. Open Beauty Facts - ingredients parser support mentions of INCI #3962
    ⏰ Stale 🥗🔍 Ingredients analysis 🧴 Open Beauty Facts +3
34. Cutter seems to be cutting sodium #2936
    ingredient-list-cutting 🐛 bug 🥗🔍 Ingredients analysis +3
35. Unknown Spanish ingredients that should be known #3625
    Spanish processing ⏰ Stale 🐛 bug 🥗 Ingredients 🥗🔍 Ingredients analysis +6
    
36. [ingredient-analysis] ingredient group in parentheses has a colon before the opening parenthesis, not parsed correctly #3959
    ⏰ Stale 🥗🔍 Ingredients analysis +2
37. Incorrect parsing for poudre de lait fermenté bio 8%**, #3187
    organic products ⏰ Stale ✨ Feature 🥗🔍 Ingredients analysis +4
38. "as a preservative" (and other additives classes) is not recognized by the ingredients parser #3089
    ⏰ Stale 🥗 Ingredients 🥗🔍 Ingredients analysis +3
39. Recognize and add upper bound for Contains 2% Or Less Of The Following #2989
    🥗 Ingredients 🥗🔍 Ingredients analysis +2
40. Poorly detected ingredients (Tracker) #2988
    🥗🔍 Ingredients analysis +1
41. Dutch ingredient parsing #5980
    Dutch ⏰ Stale 🥗🔍 Ingredients analysis +3
42. Dutch parsing of abbreviated ingredients #3829
    ⏰ Stale 🥗🔍 Ingredients analysis +2
43. "MG" for "Matière grasse" is parsed as in ingredient #3932
    ⏰ Stale 🥗🔍 Ingredients analysis +2
44. Use ingredients taxonomy to add allergens from ingredients list #3297
    Fixed ? ⏰ Stale 🌾 gluten 🥗🔍 Ingredients analysis +4
45. [Ingredient parser] "масло сладко-сливочное несолёное м. д. ж. 82,5%" actually contained that amount of fat #3924
    ⏰ Stale 🥗🔍 Ingredients analysis +2
46. ingredient fr:source #3839
    ⏰ Stale 🥗🔍 Ingredients analysis +2
47. Improve OCR recognition/processing of ingredients #3643
    OCR ingredient-list-cutting ⏰ Stale 🥗 Ingredients 🥗🔍 Ingredients analysis +5
48. "Pour" is parsed as an ingredient in "Tomates (148 g pour 100 g)" #3820
    ⏰ Stale 🥗🔍 Ingredients analysis +2
49. Add or separate states of ingredients in taxonomy #3589
    processing ⏰ Stale 🥗🔍 Ingredients analysis +3
50. How to handle ingredients in a parenthesized list #3617
    Spanish ⏰ Stale 🥗🔍 Ingredients analysis +3
51. Strange unknown ingredients #3678
    ⏰ Stale 🥗🔍 Ingredients analysis +2
52. Handle origins of ingredients in ingredient lists #3252
    ⏰ Stale 📍 Origins 🥗🔍 Ingredients analysis +3
53. &lt; or < is seen as ingredient. #3922
    ⏰ Stale 🥗🔍 Ingredients analysis +2
54. in présure (animale), animale is an ingredient #3882
    ⏰ Stale 🥗🔍 Ingredients analysis 🧬 Taxonomies +3

Part of

• Add more ingredient analysis (tracker) #5706