the only people who care about race are racists, it literally does not matter what race you are (if you insist it does because society treats different races differently, then that's a racist sentiment that you should not hold), it does not affect your life as a person, except in ways imposed by racists.
gender is something that will affect your life as a person no matter what, sure there are also societally imposed notions about gender that on a surface level could be compared to race, but they function very different on a fundamental level.
think about it this way, if we lived in a society with no racism or sexism then what color your skin is would not have a significant impact on your life, where as the gender you have would have a significant impact on your life.
edit: i want to clear up some confusion, our society is fundamentally built on racist ideals, im not trying to erase that or suggest that it isnt a reality anymore, or that we, as a society, can just stop being racist, that isnt how this works of course.
im not trying to say that you should not care about being oppressed by racists, or that your life isnt affected by people holding racist ideals, only that it shouldnt be this way. this is idealistic and not the reality we live in, but the reality i want to live in.
instead of saying "it literally does not matter what race you are (if you insist it does because society treats different races differently, then that's a racist sentiment that you should not hold)" it would be more accurate for me to have said that "saying racism matters because racist say it matters is stupid".
this is more in line with the intent i wanted to convey to the reader, however i can see how my original statement could be interpreted very different than i intended. thanks everybody for helping me state my argument more effectively