Add support for ai.txt

[chrede88]

Just like Hugo supports generating a robots.txt, it would be great Hugo could also support generating an ai.txt file.

Info: https://spawning.substack.com/p/aitxt-a-new-way-for-websites-to-set

[bep]

It's not hard to generate a ai.txt to your site (there are several ways to do this, the forum at https://discourse.gohugo.io/ is a better place to ask for that). We do have some "first class" support for robots.txt, but that is backed by a simple output format definition:

https://app.slack.com/client/T015RFZ61CM/C017GG5DUR1#:~:text=50%20bagger.-,CVNA,-5

We could consider adding this to Hugo's default setup if it's "popular enough".

[chrede88]

I understand that it's easy to generate this file. Adding this to Hugo will ensure that more people will start using it.

[ttmc]

Related: #6674