Visually impaired people have unique perceptions of and usage requirements for various urban spaces. Therefore, understanding these perceptions can help create reasonable layouts and construct urban infrastructure. This study recruited 26 visually impaired volunteers to evaluate 24 sound environments regarding clarity, comfort, safety, vitality, and depression. This data was collected in seven different types of urban spaces. An independent sample non-parametric test was used to determine the significance of the differences between environmental evaluation results for each evaluation dimension and to summarize the compositions of sound and space elements in the positive and negative influence spaces. The results suggested that visually impaired people (1) feel comfort, safety, and clarity in parks, residential communities, and shopping streets; (2) have negative perceptions of vegetable markets, bus stops, hospitals, and urban departments; (3) feel anxious when traffic sounds, horn sounds, manhole cover sounds, and construction sounds occur; and (4) prefer spaces away from traffic, with fewer and slower vehicles, with a suitable space scale, and moderate crowd density. These results provide a reference for the future design of activity venues (i.e., residential communities, vegetable markets, bus stops, parks, shopping streets, hospitals, and urban functional departments) and the planning of accessibility systems for visually impaired urban residents.