"There is a natural prejudice which prompts men to despise whomsoever has been their inferior long after he has become their equal."