Stories like this are so boring/lazy/disingenuous. You know what else tells you how to hot wire a car, make drugs, or worse? Any search engine for the last 20 years. All AI brings to the game is the possibility that the instructions you're receiving are made up.
Any search engine for the last 20 years will also keep a record of that search and possibly flag it. These kind of models you can run locally with no record of what you're using it for. For particularly harmful things I don't think you would have much luck though with a search engine although I could be wrong.
The top DDG result for "how to hotwire a car" is literally a wikihow article. Search engines and the internet in general aren't nearly as draconian as you seem to think they are. Privacy isn't so far gone yet that perfectly legal questions like "How do I make meth?" are being proactively reported to authorities. And even if you really are that paranoid, it takes about 4 minutes to download and install the Tor browser, which requires no specialized knowledge at all to use.
AI chatbots are bringing absolutely nothing new to the game when it comes to enabling crime. If I really wanted to make a pipe bomb, I'm sure I could find instructions on a legacy search engine in less than 5 minutes - and convincing most chatbots to give me probably wrong instructions for the same thing would be liable to take longer than that.
Sure but how to hotwire a car is probably one of the most mundane searches I can imagine.
These models are getting better all the time and go beyond the ability of simple search in their use cases, and with offline models they are untraceable.
What we should or shouldn't do about that is another thing but the way it's going it will be like having instant and untraceable access to an expert. Very useful and powerful but also a double edged sword.
Any search engine for the last 20 years will also keep a record of that search and possibly flag it. These kind of models you can run locally with no record of what you’re using it for.
"How dare these proles have an AI we can't spy on them with"
If you're going to release a model with lax safety controls it's going to be misused. If it's publicly downloadable it's going to be misused and untraceable. I'm with you that we live in a world now with massive overreach when it comes to government snooping but if you use your imagination I reckon you could think of some queries that someone should probably know about.