The Origins of Unfairness