Firmware UX improvements, mainly re: status

[YoshiRulz]

• The invariant of "exactly 1 Ideal option per record" is currently broken, both by records with multiple Ideal options, and I think by a couple records with none. This restriction on humans has been lifted and the documentation changed to match the existing behaviour.
• The autodetect code (in FirmwareManager IIRC) chooses the first record which can be resolved to a file. But that means, if you had both an Ideal and an Acceptable firmware in your firmware dir, it might use the Acceptable one. This could be fixed by ensuring the options list is sorted by status.
• A review of which firmwares work and which don't might be warranted, but once you start testing games, there's no obvious cut-off point. The requirements could grow indefinitely. So maybe just... have TASVideos judges read them over? judges apparently not interested, moved to https://gitlab.com/YoshiRulz/yoshis-hawk-thoughts/-/issues/219

[Morilli]

The invariant of "exactly 1 Ideal option per record" is currently broken

Looking at e18a349, it feels like setting all to ideal makes sense, so maybe this invariant doesn't need to exist?
In any case, unit tests could work nicely to enforce the first two points.

[YoshiRulz]

Yes, I forgot to mention these aren't covered by the existing unit tests, hence they've been neglected.

[vadosnaprimer]

So maybe just... have TASVideos judges read them over?

What do you mean?

In general regarding firmwares, I think we need different icons, because the current ones are too cryptic.

Bad could be a "thumbs down", acceptable a "thumbs up", unacceptable - a red cross, and ideal - a star from SMW.

Also I don't see the benefit of only allowing 1 to be ideal.

[YoshiRulz]

So maybe just... have TASVideos judges read them over?

What do you mean?

Asking people from the TASing community with extensive knowledge of a particular console, such as judges, to confirm that we've made the best choices. (Which I believe is how the FW database was populated in the first place.)

I think we need different icons, because the current ones are too cryptic. [...] a star from SMW.

I'm sympathetic to this, but we only "just" got them working properly in 1026503 (2.9).
If you do change them, please use only Public Domain images—see also my personal notes #36.
edit: done in 9e9687f

Also I don't see the benefit of only allowing 1 to be ideal.

It would help reduce the diversity of setups. (A boon for judges?) Unfortunately, these bugs prevent that.

[vadosnaprimer]

Asking people from the TASing community with extensive knowledge of a particular console, such as judges, to confirm that we've made the best choices. (Which I believe is how the FW database was populated in the first place.)

People who added the cores had the most knowledge about firmwares. I don't think judges were involved at any point in any way.

I'm sympathetic to this, but we only "just" got them working properly in 1026503 (2.9).

"Properly" is a subjective assessment, and I don't remember anyone for whom the current icons were immediately perfectly clear. Also 2.9 was just last year, I don't think everyone accustomed to them once and for all.

It would help reduce the diversity of setups. (A boon for judges?)

Has this been discussed with them, to determine it's the problem they're having? Since hawk auto selects the needed firmware given the path, all judges look at is whether it's an acceptable BIOS for a given machine, which hawk indicates.

[CasualPokePlayer]

Ideal should generally be what's ideal to the core. The ideal choices for PSX for example would the v3.0 images, as that's what mednafen was designed with. This would have nothing involving TASVideos judges.

For the example SGB records, iirc I did that under the assumption that "all of them are equally ideal" and by logic assigning multiple ideal tags (although that was long ago so idk)

[Morilli]

Can we consider this resolved now or does anyone disagree with the changes made? Namely that ideal does NOT need to exist exactly once and that the firmware manager will now prefer ideal over acceptable firmware in case both are available?

[vadosnaprimer]

I guess so.