Many of our attitudes are non-culpable: there was nothing that we should have done to avoid holding them. I argue that we can still be blameworthy for non-culpable attitudes: they can impair our relationships in ways that make our full practice of apology and forgiveness intelligible. My argument poses a new challenge to indirect voluntarists, who attempt to reduce all responsibility for attitudes to responsibility for prior actions and omissions. Rationalists, who instead explain attitudinal responsibility by appeal to reasons-responsiveness, can make sense of blameworthiness for non-culpable attitudes. In response, voluntarists could propose a revision of our actual practices. This would lead us into a quite different debate.