Allow specific query parameters to be ignored

[royteeuwen]

It would be nice to have the ability to disable (specific) query parameters to be counted as separate pages. For example we use query parameters to show analytics where the click comes from:

If the link was clicked in the footer of the page, the page url will be https://www.example.com/my-page?zone=footer
While if we click from the breadcrumb it would be https://www.example.com/my-page?zone=breadcrumb

But this means that the page would be picked up three times by the crawler, one time without query parameter, and two times with the zone query parameter. It would be nice to have a possibility to disable this because that would speed up the scan almost by three