Part of the cultural perception is that cats have different communication style to humans.
Part of it is only interacting with other people's cats at their house, which may not necessarily be comfortable with guests.
Part of it is a legacy perception that cats are a feminine or queer pet to have, though I think internet culture has actually changed this a lot. I still encounter old dudes that think having a cat is weird though.
Dogs are pretty thoroughly domesticated and have behaviors/communication tailored towards interacting with people. Cats still kinda just treat us like they treat other cats, so there's almost a language barrier there and it can take some getting used to.
Didn’t cats self domesticate? Whereas dogs domesticated us /jk. We domesticated them, but they are probably the most in-sync with us out of all other species.