I believe the answer is: Who has power and privilege and who does not
Many sociologist believe that minority status would affect the hardship that a certain social group would experience in their effort to advance in a society. (the more power that the group have, the less hardship they would experience in the process)