Cognitive impairment is viewed as a core symptom of schizophrenia (SCZ), but its pathophysiological mechanism remains unclear. White matter (WM) disruption is considered to be a central abnormality that may contribute to cognitive impairment in SCZ patients. However, few studies have addressed the association between cognition and WM integrity in never-treated first-episode (NTFE) patients with SCZ. In this study, we used the MATRICS Consensus Cognitive Battery (MCCB) to evaluate cognitive function in NTFE patients (n = 39) and healthy controls (n = 30), and associated it with whole-brain fractional anisotropy (FA) values obtained via voxel-based diffusion tensor imaging. We found that FA was lower in five brain areas of SCZ patients, including the cingulate gyrus, internal capsule, corpus callosum, cerebellum, and brainstem. Compared with the healthy control group, the MCCB's total score and 8 out of 10 subscores were significantly lower in NTFE patients (all p < 0.001). Moreover, in patients but not healthy controls, the performance in the Trail Making Test was negatively correlated with the FA value in the left cingulate. Our findings provide evidence that WM disconnection is involved in some cognitive impairment in the early course of SCZ.