That's not how the Empire works. The Empire is not racist, at least not to everyone out there. They see Dwarves and Elves as allies. Of course, if you are slightly tainted by Chaos such as having horns or tails, they will burn you.