What’s the actual reason neurodivergent people are sometimes discriminated against or bullied?

This is coming from a neurodivergent guy. I just don’t get it. I mean, I know it’s probably because we act differently, but WHY EXACTLY do some people decide we’re lesser than neurotypical people?