Adopt linkable paths

[daveverwer]

Fixes #2471

Hard to test the performance on dev as I don't think we have any of the huge packages with the files there, but we can test it on prod once it's deployed and the documentation re-generation has completed.

[daveverwer]

We shouldn't deploy this until the re-generation has completed to avoid Google seeing empty sitemaps where they were previously full of data.

[finestructure]

Fixes #2471

Hard to test the performance on dev as I don't think we have any of the huge packages with the files there, but we can test it on prod once it's deployed and the documentation re-generation has completed.

If you trigger a build for the doc build version via the Run trigger-builds -v ... -p ... -s ... it won't be affected by the downscaling.

[daveverwer]

If you trigger a build for the doc build version via the Run trigger-builds -v ... -p ... -s ... it won't be affected by the downscaling.

I'm deploying this branch to dev to test that and I'll kick off a SwiftSyntax build, too

[daveverwer]

This has had less of a performance impact than I hoped it would.

StreamChatSwiftUI on production, with the huge linkable-entities.json file took 52 seconds to generate the sitemap just now. This version on staging using linkable-paths.json took 46 seconds.

This is still a step in the right direction, but we may want to look further at what's taking it so long to run.

Slightly more worrying, and why I am not going to merge this yet is that the files from prod/staging are different sizes. I am struggling to find anything that can diff them, but I'll write a little script tomorrow to extract just the urls and diff those.

[daveverwer]

Slightly more worrying, and why I am not going to merge this yet is that the files from prod/staging are different sizes. I am struggling to find anything that can diff them, but I'll write a little script tomorrow to extract just the urls and diff those.

OK I wrote the script tonight as it was bugging me why these would be different, and the good news is that they are not. There were just staging. prefixes to all the URLs in one of the files.

How do I even function as a human being? 🙄

[daveverwer]

I'll merge and deploy this tomorrow.

[daveverwer]

Deploying as 2.88.1

[daveverwer]

Only a negligible increase in performance.

Before:

$ curl https://swiftpackageindex.com/GetStream/stream-chat-swiftui/sitemap.xml > stream-old.xml
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 9387k  100 9387k    0     0   182k      0  0:00:51  0:00:51 --:--:-- 2363k

After:

$ curl https://swiftpackageindex.com/GetStream/stream-chat-swiftui/sitemap.xml > stream-new.xml
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 9387k  100 9387k    0     0   188k      0  0:00:49  0:00:49 --:--:-- 2163k