Understanding how surfaces direct nucleation is a complex problem that limits our ability to predict and control crystal formation. We here address this challenge using high-speed imaging to identify and quantify the sites at which ice nucleates in water droplets on the two natural cleavage faces of macroscopic feldspar substrates. Our data show that ice nucleation only occurs at a few locations, all of which are associated with micron-size surface pits. Similar behavior is observed on α-quartz substrates that lack cleavage planes. These results demonstrate that substrate heterogeneities are the salient factor in promoting nucleation and therefore prove the existence of active sites. We also provide strong evidence that the activity of these sites derives from a combination of surface chemistry and nanoscale topography. Our results have implications for the nucleation of many materials and suggest new strategies for promoting or inhibiting nucleation across a wide range of applications.