Alzheimer's disease dementia (ADD) and subcortical vascular dementia (SVaD) both show cortical thinning and white matter (WM) microstructural changes. We evaluated different patterns of correlation between gray matter (GM) and WM microstructural changes in pure ADD, pure SVaD, and mixed dementia. We enrolled 40 Pittsburgh compound B (PiB) positive ADD patients without WM hyperintensities (pure ADD), 32 PiB negative SVaD patients (pure SVaD), 23 PiB positive SVaD patients (mixed dementia), and 56 normal controls. WM microstructural integrity was quantified using fractional anisotropy (FA), axial diffusivity (DA), and radial diffusivity (DR) values. We used sparse canonical correlation analysis to show correlated regions of cortical thinning and WM microstructural changes. In pure ADD patients, lower FA in the frontoparietal area correlated with cortical thinning in the left inferior parietal lobule and bilateral paracentral lobules. In pure SVaD patients, lower FA and higher DR across extensive WM regions correlated with cortical thinning in bilateral fronto-temporo-parietal regions. In mixed dementia patients, DR and DA changes across extensive WM regions correlated with cortical thinning in the bilateral fronto-temporo-parietal regions. Our findings showed that the relationships between GM and WM degeneration are distinct in pure ADD, pure SVaD, and mixed dementia, suggesting that different pathomechanisms underlie their correlations.