Allergies are not as linear as allergy = death/miserable. Some dander is not the same as others and some people only react to certain types. He could have just been bullshitting too.
Allergy meds can also help a ton. I'm mildly allergic. Congestion, itchy eyes and face. I had one cat, married into 5 more. I'm fine as long as I stay on top of my allergy meds.
My sister was very allergic to cats when she was a kid. Then one day she just sort of turned up with this cat. My sister's friends cat had kittens and this was one of the kittens.
Anyway she was afraid my parents would say no so she hid the cat in her room for 2 or 3 days before my parents noticed. By which point it was somewhat of a done deal.
Anyway 16 years later when the cat died my sister was no longer allergic, so if you spend enough time around them you do eventually become desensitized. Or at least some people seem to.
I'm allergic to cats but grew up with one (she lived to 21!) and my fiance has a cat and we moved in together. It's fine I just have to keep the cat away from my face and I wash my hands after petting her.
Even if I don't I just get really itchy, it's not the worst. Worth it for the pets and cuddles.