AI dismissives aren't allowed to comment in this post.
You are allowed to comment if you absolutely hate AI, or love it. If you think it is overrated or underrated, ok (although I think it's too early to say what the consensus even is to know whether it is overrate/underrated). But if you think it is just a scam, gimmick, grift, etc I don't need to hear from you right now :soviet-heart:
Let the discussion begin:
So it's clear there's this big alignment debate going on rn. Regardless where you stand, isn't it fucked that there's a cabal of the biggest freaks money has ever produced debating the future of humanity with zero input from normal society?
Even if it isn't humanity's future they think it is. There's probably like 100 people in the world paid to work on alignment. How can you not develop a megalomania complex?
What kind of chatter are you hearing about AI?
I very occasional hear people irl obliquely mention AI. A cashier said like 'oh that AI stuff, that's pretty scary'. That's about it.
Now the blogs I follow have been basically colonized by AI news. These aren't even strictly technology blogs. I started following David Brin for UFO takes, I started following Erik Hoel for neuroscience takes. Literally everyone I follow has published takes on AI and zero of them dismiss it out of hand.
Sorry this will get long.
I basically feel like we are in another version of the post nuclear age except only insiders know it. After the first A-bomb, everyone knew the world was different starting the very next day. Now only designated take-havers are aware of this new reality.
Or regular folks are aware of it but they're so disempowered from having a say that they only engage with the realization online like I'm doing now. Medicare for all is Bernie's thing. The border is Trump's. Even if nothing will ever be done about healthcare, the fact that Bernie talks about it justifies you thinking about it. AI isn't any politician's thing.
I'd put the odds of a nuclear war around 1% a year. I'd say there's a 1% chance AI can be as world-ending as that. That's such a low number that it doesn't feel like "AI doomerism". But 1% multiplied by however much we value civilization is still a godalmighty risk.
When I've heard this site talk about it, it's usually in the context of "holy shit this AI art is garbage compared to real art? Where's the love, where's the soul?" If it was 1945 and we nuked a city, would you be concerned with trying to figure out what postmodernism would look like?
Usually when I've gotten to the end of my post I delete it.
But if you think it is just a scam, gimmick, grift, etc I don’t need to hear from you right now
Too bad! :garf-troll:
I don't think computers can have a mind. It's a maths machine. Mechanically following a predetermined set of instructions, toggling switches as its rule-set requires. Everything else is abstraction. Desktops and programmes and widgets and websites are just patterns in the switches that people have agreed to peg meaning onto. Circuits and switches can no more hold a mind than the pulp and ink of a book.
The existential threat of "AI" is our leaders, both public and private, turning over decision making to what is essentially a complicated, yet brainless, abacus.
Yes, organic chemicals can produce a mind. Yes, they are determined by physical properties. What sets you and me and the dog apart from computers is which physical properties are in play.
Computer engineers use reliable physical properties to make predictable, deterministic logic gates. Doesn't matter what programme you run (or, inversely, which computer you run the programme on) the gates always behave predictably. Make them too small, though, and quantum effects overtake the predictable properties. The machine stops being predictably deterministic and cannot function as a computer.
We don't know how minds come about. Programmer types like to say it's the interaction between neurons – that each cell behaves like a logic gate in a computer. That is pure conjecture. They want that to be the case.† And… reality doesn’t quite line up with that story. Anesthetics points to a deeper level of physical phenomena.
When a patient goes into surgery, it’s not ideal for them to be conscious during it. So we switch that off, with some good ol’ anesthetics! And I do mean “switched off” – anesthetized patients don’t even dream. How does it happen? For the longest time, nobody was sure. An anesthesiologist and some researchers decided to look into it. What they found is that anesthetics blocks the formation of these little structures inside cells, called microtubuals.
From what I (mis)understand, quantum physicists find microtubuals really interesting. Something to do with radial symmetry and interactions between the molecules that make up the tube? I don’t understand quantum. The point is, whatever explanation for consciousness we find, it looks like it’s gonna include some quantum-chemical properties that don’t gel well with computable mathematics. Which shouldn't be all too surprising. Even photosynthesis depends on quantum phenomena to get the electromagnetic radiation into the cell.
__
†
It makes their tables of variables strung up to other tables of variables seem like boundary-pushing research into the depths of consciousness itself – as opposed to just a calculation heavy, brute-force approach to problem solving.