Dorso-lateral prefrontal cortex is thought to contribute to adaptive behavior by integrating temporally dispersed, behaviorally-relevant factors. Past work has revealed a variety of neural representations preceding actions, which are involved in internal processes like planning, working memory and covert attention. Task-related activity following actions has often been reported, but so far lacks a clear interpretation. We leveraged modified versions of classic oculomotor paradigms and population recordings to show that post-saccadic activity is a dominant signal in dorso-lateral prefrontal cortex that is distinct from pre-saccadic activity. Unlike pre-saccadic activity, post-saccadic activity occurs after each saccade, although its strength and duration are modulated by task context and expected rewards. In contrast to representations preceding actions, which appear to be mixed randomly across neurons, post-saccadic activity results in representations that are highly structured at the single-neuron and population level. Overall, the properties of post-saccadic activity are consistent with those of an action memory, an internal process with a possible role in learning and updating spatial representations.