This review examines the development of atomically resolved electron energy loss spectroscopy from the first demonstration of plane-by-plane compositional profiling, through column-by-column spectroscopy to full two-dimensional and potentially three-dimensional spectroscopic imaging. Examples will be presented to highlight the increasing analytical sensitivity and image contrast obtained through each generation of aberration correction, moving towards the ultimate goal of mapping electronic structure inside materials with atomic resolution.