With the development of robot technology, integrated joints with small volume and convenient installation have been widely used. Based on the double inertia system, an integrated joint motor servo system model considering gear angle error and friction interference is established, and a joint control strategy based on BP neural network and pole assignment method is designed to suppress the vibration of the system. Firstly, the dynamic equation of a planetary gear system is derived based on the Lagrange method, and the gear vibration of angular displacement is calculated. Secondly, the vibration displacement of the sun gear is introduced into the motor servo system in the form of the gear angle error, and the double inertia system model including angle error and friction torque is established. Then, the PI controller parameters are determined by pole assignment method, and the PI parameters are adjusted in real time based on the BP neural network, which effectively suppresses the vibration of the system. Finally, the effects of friction torque, pole damping coefficient and control strategy on the system response and the effectiveness of vibration suppression are analyzed.