Carotid plaque prone to release emboli may be predicted by increased strain variations within plaque due to arterial pulsation over a cardiac cycle. Non-invasive ultrasound strain imaging may therefore be a viable surrogate to determine the risk of embolic stroke and possible cognitive impairment. Ultrasound strain imaging was performed on 24 human subjects with significant plaque, who also underwent standardized cognitive assessment (Repeatable Battery for the Assessment of Neuropsychological Status (RBANS)) prior to a carotid endarterectomy (CEA) procedure. Radiofrequency signals were acquired using a Siemens Antares with a VFX 13-5 linear array transducer. Plaque regions were segmented by a radiologist at end-diastole using the Medical Imaging Interaction Toolkit. A hierarchical block-matching motion tracking algorithm was utilized to estimate the cumulated axial, lateral, and shear strains within the imaging plane. The maximum strain indices of the plaque, defined as mean accumulated strain over a small region of interest in the plaque with large deformations, were obtained. All the strain indices were then correlated with RBANS Total score. Overall cognitive performance was negatively associated with maximum axial and lateral strains respectively. The results demonstrate a direct relationship between the maximum axial and lateral strain indices in carotid plaque and cognitive impairment.