Index page dicts - links to masterlist tropes only

[jwzimmer-zz]

From: #17

Make new dicts from the index pages (need a masterlist of indices too) that only include tropes that are in our masterlist.

[jwzimmer-zz]

Masterlist of indices - things in main (https://tvtropes.org/pmwiki/index_report.php) that aren't listed as tropes in our tropes masterlist?

[nguyenhphilip]

Done! Script here: https://github.com/jwzimmer/tv-tropes/blob/main/pull-index.ipynb

Index master dictionary as well as individual files: https://github.com/jwzimmer/tv-tropes/tree/main/index-list

Have ~4218 indices. Will probably need some way to filter these as we likely don't want this many in our visualization.

[jwzimmer-zz]

Oh whoops I did not see your comment here, my bad! This is great, thanks!

So this is: for every entry in Main Indices (https://tvtropes.org/pmwiki/index_report.php), if it links to tropes in our masterlist of tropes, then we now have a dictionary of those tropes? (In other words, no indices that have no links to tropes in our masterlist, and no tropes that are not in our masterlist?)

What about the case when an index linked to another index (if that happened ever)?

[jwzimmer-zz]

Resolved by @nguyenhphilip