Workers can have good or bad work habits. These traits are transmitted from one generation to the next through a learning and imitation process, which depends on parents' investment in the trait and the social environment where children live. We show that if a sufficiently high proportion of employers have taste-based prejudices against minority workers, their prejudices are always self-fulfilled in steady state and minority workers end up having, on average, worse work habits than majority workers. This leads to a ghetto culture. Affirmative Action can improve the welfare of minorities whereas integration can be beneficial to minority workers but detrimental to workers from the majority group.