Gov.ie excludes all major AI bots except Mistral

Syndicated from the fediverse. Read and engage on the original instance.

Gov.ie excludes all major AI bots except Mistral

Ireland’s government website, gov.ie, has a quite comprehensive robots.txt file, which by excludes almost all crawlers associated with AI training from scraping the site. One missing however is Mistral.

https://www.gov.ie/robots.txtOpen link View original on lemmy.world

Comments2

2 replies

breadsmasher

lemmy.world

jokes on them, LLM companies dont care about robots.txt

zod000 reply

lemmy.dbzer0.com

Exactly, but I almost see this the other way. Not mentioning Mistral could just signal that they weren't important enough to even get mentioned.