7. Shape and Motion Integration in People Perception Depends on the Action of the Performer
Perception of human action depends on both the body shape and motion of a performer. We can indirectly perceive the properties of an object being acted upon even when visual information is limited and the object itself is not visible; we accomplish this using internal models of a body’s dynamics and an action’s kinematics (Runeson & Frykholm, 1981). We are also sensitive to correlations between a performer’s shape and motion, known as internal consistency (Runeson & Frykholm, 1983). To investigate how decorrelating shape and motion affects indirect object perception, we ran an experiment where participants watched realistic avatars of performers manipulating invisible objects. Unbeknownst to participants, half of the stimuli were internally inconsistent: the shape of one performer was combined with the motion of a performer with a dissimilar body shape. Participants saw sled pushes, beanbag throws, and box lifts, and estimated the sled weight, throw distance, or box weight. For sled pushes, there was a shape-motion interaction such that heavy bodies were perceived as pushing heavier weights when animated with motion from light performers, and light bodies were perceived as pushing lighter weights when animated with motion from heavy performers. In contrast, participants estimated beanbag throw distance primarily from performer motion. Interpretation of the box lift data is more complex. In conclusion, the way in which our visual system combines shape and motion information depends on the role of body shape and centre of mass on the outcome of an action.