For the people who didn't read the article. Read this TLDR:
When you open a Google Doc. A Gemini sidebar appears, so you can ask questions about the document. Here, it summarized a document without the user asking.
The article title makes it seem like they are using your files to train AI which no proof exists for that(yet)
At least the data is sent to Gemini servers. This alone can be illegal but I'm not sure. What I'm more sure about is that they do use the data to train the models.
Since it is Google Docs, the data is already on Google servers. But yeah, it doesn't exactly instill confidence into the confidentiality of documents on Google Docs.
Generative AI doesn't get any training in use. The explosion in public AI offerings falls into three categories:
Saves the company labor by replacing support staff
Used to entice users by offering features competitors lack (or as catch-up after competitors have added it for this reason)
Because AI is the current hot thing that gets investors excited
To make a good model you need two things:
Clean data that is tagged in a way that allows you to grade model performance
Lots of it
User data might meet need 2, but it fails at need 1. Running random data through neural networks to make it more exploitable (more accurate interest extraction, etc) makes sense, but training on that data doesn't.
This is clearly demonstrated by Google's search AI, which learned lots of useful info from Reddit but also learned absurd lies with the same weight. Not just overtuned-for-confidence lies, straight up glue-the-cheese-on lies.
Yes. Now its documented that Google is violating their terms of service. I'm sure their lawyers will point to the clause that says they can change the terms of service at any time without warning
There's a certain level of due-diligence that you can use when you're moving personal information around on the cloud. Hospitals have a legal obligation to keep your medical records secure; Google does not.