Limited output

[azetxxx]

Hi there,

they say, they have over 360.000 recipes, but the search output has only 24 pages / 1000 output items. Is this true, or are I doing something wrong? (Can I use your tool for more than 1000 recipes? - I want to build a ML model)

[TobiasPleyer]

Hi
That is hard to say. How many recipes really exist only they know, but I am very certain it is more than 24.000. The fact that we can't see more is most likely a server limit. For obvious reasons the website does not want to expose its database. So all my tool can do is somehow get to this data via HTTP requests. If you hit a limit there not much you can do. It is also very hard to maintain this parser because they regularly change the structure of their web pages. Partly for improvements but mostly to stop crawlers like mine to prevent data theft from competitors I assume.
When you search recipes on their site they of course search in their internal database and maybe there are 360k items...