White matter architecture in patients with social anxiety disorder (SAD) has rarely been investigated, but may yield insights with respect to altered structural brain connectivity. Initial evidence points to alterations in the uncinate fasciculus (UF). We applied diffusion tensor imaging in 25 patients with SAD and 25 matched healthy subjects. Whole-brain fractional anisotropy (FA) maps were used for group comparison and voxel-wise correlation with psychometric and clinical measures. Additionally, a region-of-interest analysis of the UF was performed. Patients with SAD had reduced FA compared to healthy subjects in or near the left UF and the left superior longitudinal fasciculus. There were no regions with increased FA in SAD. In the region-of-interest analysis, a negative correlation between FA and trait anxiety was identified in the left and right UF in patients, but not in healthy subjects. No correlations with social anxiety scores were observed. The present study partially confirms previous results pointing to frontal WM alterations in or near the UF in patients with SAD. SAD-specific dimensional associations of FA with trait anxiety might reflect general pathological and/or compensatory mechanisms as a function of symptom severity in patients. Future studies should disentangle in which way the identified WM alterations match functional alterations.