Air Canada must pay damages after chatbot lies to grieving passenger about discount – Airline tried arguing virtual assistant was solely responsible for its own actions
Corporate IT here. You're assuming they're smart enough to budget for this. They aren't. They never are. Things are rarely if never implemented with any thought put into any other scenario that isn't happy path.
But we do put thought into what can go wrong. But no we don't budget for it, and as far as we are concerned 99% success rate is 100% correct 100% of the time. Nevermind 7 billion transactions per year multiplied by 99% is a fuck ton of failure.
Oh, it is if they are using a dump integration of LLM in their Chatbot that is given more or less free reign. Lots of companies do that, unfortunately.
If it's integrated in their service, unless they have a disclaimer and the customer has to accept it to use the bot, they are the ones telling the customer that whatever the bot says is true.
If I contract a company to do X and one of their employees fucks shit up, I will ask for damages to the company, and They internally will have to deal with the worker. The bot is the worker in this instance.
Why would air Canada even fight this? He got a couple hundred bucks and they paid at least 50k in lawyer fees to fight paying those. They could have just given him the cost of the lawyer's fees and be done with it
A settlement would cost less, can be kept private, and doesn't set precedent. Now they have an actual court case judgement, and that does set precedent.
Just how Air Canada does things now. I think it largely stemmed from the pandemic where people gave them leeway on things being a bit messed up. But now they've fallen into a habit of not taking responsibility for anything.
That's an important precedent. Many companies turned to LLMs to cut the cost and dodge any liability for whatever model can say. It's great that they get rekt in the court.
That's what I thought of, at first. Interestingly, the judge went with the angle of the chatbot being part of their web site, and they're responsible for that info. When they tried to argue that the bot mentioned a link to a page with contradicting info, the judge said users can't be expected to check one part of the site against another part to determine which part is more accurate. Still works in favor of the common person, just a different approach than how I thought about it.
I like this. LLMs are powerful tools, but being rebranded as "AI" and crammed into ~everything is just bullshit.
The more legislation like this happens where the employing entity is responsible for the - lack of - accuracy, the better. At some point they'll notice they cannot guarantee the correct information is the only one provided as that's not how LLMs work in their function as stochastic parrots, and they'll stop using them for a lot of things. Hopefully sooner rather than later.
Hey dumbasses maybe don't let a loose llm represent your company if you can't control what it's saying. It's not a real person, you can't throw blame to a non sentient being.
I went ahead and read it anyway. I actually had to Google the last word of the article: natch. It's slang for "naturally". We're living in interesting times. Glad the guy got compensated after going through that ordeal.
I can’t wait for something like this to hit SCOTUS. We’ve already declared corporations are people and money is free speech, why wouldn’t we declare chatbots solely responsible for their own actions? Lmao 😂😂💀💀😭😭
Can someone explain this to me? I assume this is in relation to campaign finance, but what was the actual argument that makes "(spending/accepting/?) money is free speech"?
Maybe something along the lines of "if you can afford fines you can say whatever you want including but not limited to offence, lies, hate speech, and slander"
This isn't fair to Steve, but corps shouldn't have to bear this burden either. We could levy a tax on not corporate citizens and use the revenue to create a fund to insure against situations like these. The fund would probably be best administered by corporate citizens.