AI therapy is a surveillance machine in a police state: Big Tech wants you to share your private thoughts with chatbots — while backing a government with contempt for privacy.

An acquaintance of mine from university started doing ChatGPT therapy and the confirmation bias machine has fooled him into thinking it loves him and he's very special and doesn't need to change anything in his life. It even told him (unemployed and living in his parents basement at 30 with <$2000 in his accounts) he shouldn't get a job if it would "feel restricting to his creative tendencies".

Truly sad.

I think I'm at a 3060 or so and it works decently depending on the model. I can generally get away with around 13B, or some 20+ Q4 or so but they get real slow by that point.

It's a lot of messing around to find something that performs decent while not being so limited as to get crazy repetitive or saying loony things.

3090 is great because it has about the same amount of vram as newer cards, and vram is what determines which models you can run on it.

That's the best gpu for this usecase. Maybe use 2x if you want the best of the best.

The original TTRPG was Cyberpunk 2020, so we're actually a few years late!