PR Preview does not appear to be updating anymore

[annevk]

Usually a rebase triggers the attention of the bot, but that doesn't seem to be the case anymore. Noticed this in whatwg/url#513.

WHATWG stopped using Travis recently, could that be related somehow?

[annevk]

whatwg/html#5654 is an example where PR Preview didn't do anything.

[tobie]

This has been reported elsewhere too. I’m not sure what the issue is and didn’t have the cycles to investigate so far.

[tobie]

Fixed by 9fb0a85

[tobie]

Post Mortem

Current situation

The problem is fully resolved and PR Preview is working normally.
To retrigger a build, please edit the body of the pull request on GitHub (e.g. just a line break).

Duration of outage

Multiple days. The outage was so long because the alert system failed to handle this as an error case.

Cause of outage

The outage was due to Github having deprecated an API endpoint way in advance of the announced plan.

The problem was compounded by the error message being logged not containing the keyword "error". As a result, it wasn't picked by the email alert system, and I wasn't made aware of it until Anne filed an issue against the repository.

Solution

The cause of the outage was quickly identified. The solution was to upgrade to the new API endpoint. This resolved the issue right away.

A support ticket was filed with GitHub to let them know about this issue.

Follow-ups

• Issues were filed to (1) make sure that error handling would catch such cases in the future, and (2) improve logging so that failed builds could be re-run once the problem was solved.
• Searching for funding to pay for the development of these issues and others, and cover maintenance costs should be re-prioritized.