The Collapse of GPT: Will future artificial intelligence systems perform increasingly poorly due to AI-generated material in their training data?
The Collapse of GPT – Communications of the ACM
How about we dont feed AI to itself then? Seems like that's just a choice we could make?
They don't have decent filters on what they fed the first generation of AI, and they haven't really improved the filtering much since then, because: on the Internet nobody knows you're a dog.
when you flood the internet with content you don't want, but can't detect, that is quite difficult
It is a hard problem. Any "human" based filtering will inevitably introduce bias, and some bias (fact vs fiction masquerading as fact) is desirable. The problem is: human determination of what is fact vs what is opinion is... flawed.
Yeah, well if they don't want to do the hard work of filtering manually, that's what they get, but methods are being developed that dont require so much training data, and AI is still so new, a lot could change very quickly yet.