7mo ago

When A.I.’s Output Is a Threat to A.I. Itself | As A.I.-generated data becomes harder to detect, it’s increasingly likely to be ingested by future A.I., leading to worse results.

www.nytimes.com When A.I.’s Output Is a Threat to A.I. Itself

As A.I.-generated data becomes harder to detect, it’s increasingly likely to be ingested by future A.I., leading to worse results.

New York Times gift articles @sopuli.xyz

silence7 @slrpnk.net

7mo ago

When A.I.’s Output Is a Threat to A.I. Itself | As A.I.-generated data becomes harder to detect, it’s increasingly likely to be ingested by future A.I., leading to worse results.

www.nytimes.com /interactive/2024/08/26/upshot/ai-synthetic-data.html

12 2

You're viewing a single thread.

53 comments

Maybe this will become a major driver for the improvement of AI watermarking and detection techniques. If AI companies want to continue sucking up the whole internet to train their models on, they'll have to be able to filter out the AI-generated content.
- "filter out" is an arms race, and watermarking has very real limitations when it comes to textual content.
  
  I'm interested in this but not very familiar. Are the limitations to do with brittleness (not surviving minor edits) and the need for text to be long enough for statistical effects to become visible?
  
  Yes — also non-native speakers of a language tend to follow similar word choice patterns as LLMs, which creates a whole set of false positives on detection.

53 comments