Working memory is a set of cognitive operations facilitating higher order cognition and complex behavior. A particularly important aspect of working memory is the linkage of past sensory events to planned actions. While the lateral prefrontal cortex has been proposed to serve this temporal integrative function, the precise mapping of specific components of this process within the lateral prefrontal cortex has yet to be clarified. In this human fMRI experiment, we employed a paradigm that segregates retrospective sensory maintenance from prospective action planning processes. Our results suggest that the ventrolateral PFC supports retrospective sensory representations while the dorsolateral PFC supports prospective action representations.