Program that takes in a file with one URL per line and removes all lines with duplicate parameters Do note, that these are not considered duplicates and both versions will be in the output:
Example 1:
Example 2:
$ python3 clean.py <filepath>
$ <original_file_name>_clean<original_file_extenstion>