Rapidly and accurately obtaining collapsed building information for earthquake-stricken areas can help to effectively guide the implementation of the emergency response and can reduce disaster losses and casualties. This work is focused on rapid building earthquake damage detection in urban areas using a single post-earthquake polarimetric synthetic aperture radar (PolSAR) image. In an earthquake-stricken area, the buildings include both damaged buildings and undamaged buildings. The undamaged buildings are made up of both parallel buildings, whose array direction is parallel to the flight direction, and oriented buildings, whose array direction is not parallel to the flight direction. The damaged buildings after an earthquake are made up of completely collapsed buildings and residual damaged parallel walls and oriented walls of the damaged buildings. Therefore, we divide the buildings in earthquake-stricken areas into five kinds: intact parallel buildings, damaged parallel walls, collapsed buildings, intact oriented buildings, and damaged oriented walls. The two new polarimetric feature parameters of λ_H and H_λ are proposed to recognize the five kinds of buildings, and the Wishart supervised classification method is employed to further improve the extraction accuracy of the damaged buildings and undamaged buildings.