Enhanced Recognition of Amputated Wrist and Hand Movements by Deep Learning Method Using Multimodal Fusion of Electromyography and Electroencephalography

Motion classification can be performed using biometric signals recorded by electroencephalography (EEG) or electromyography (EMG) with noninvasive surface electrodes for the control of prosthetic arms. However, current single-modal EEG and EMG based motion classification techniques are limited owing to the complexity and noise of EEG signals, and the electrode placement bias, and low-resolution of EMG signals. We herein propose a novel system of two-dimensional (2D) input image feature multimodal fusion based on an EEG/EMG-signal transfer learning (TL) paradigm for detection of hand movements in transforearm amputees. A feature extraction method in the frequency domain of the EEG and EMG signals was adopted to establish a 2D image. The input images were used for training on a model based on the convolutional neural network algorithm and TL, which requires 2D images as input data. For the purpose of data acquisition, five transforearm amputees and nine healthy controls were recruited. Compared with the conventional single-modal EEG signal trained models, the proposed multimodal fusion method significantly improved classification accuracy in both the control and patient groups. When the two signals were combined and used in the pretrained model for EEG TL, the classification accuracy increased by 4.18–4.35% in the control group, and by 2.51–3.00% in the patient group.

The Film in Hand Modes of Coordination and Assisted Virtuosity in the Bombay Film Studios

Less has been said about the hand movements of the film makers, their cultural dimension and the place of this "corporate language" in the film making process, probably because this object is difficult to capture even with a diary. Gestures go too fast to be sketched on the spot and often faster than the perception of the ethnographer. Some of these gestures are made to stabilize the frame or simulate the camera movement but lots of them are difficult to classify and don't fall into this category, like the ones which are produced to accompany the actors' action or to invite him to perform a certain action and which have more to do with a mode of demonstration involving the entire body. This article, mostly based on videos of Bombay film makers at work, tries to identify the specificity of these gestures in terms of communication or interaction and their potential of coordination in the film set dynamics.

Identify Finger Rotation Angles with ArUco Markers and Action Cameras

Measuring the motions of human hand joints is often a challenge due to the high number of degrees of freedom. In this study, we proposed a hand tracking system utilizing action cameras and ArUco markers to continuously measure the rotation angles of hand joints. Three methods were developed to estimate the joint rotation angles. The pos-based method transforms marker positions to a reference coordinate system (RCS) and extracts a hand skeleton to identify the rotation angles. Similarly, the orient-x-based method calculates the rotation angles from the transformed x-orientations of the detected markers in the RCS. In contrast, the orient-mat-based method first identifies the rotation angles in each camera coordinate system using the detected orientations, and then, synthesizes the results regarding each joint. Experiment results indicated that the repeatability errors with one camera regarding different marker sizes were around 2.64 to 27.56 degrees and 0.60 to 2.36 degrees using the marker positions and orientations respectively. When multiple cameras were employed to measure the joint rotation angles, the angles measured by using the three methods were comparable with that measured by a goniometer. Despite larger deviations occurred when using the pos-based method. Further analysis indicated that the results of using the orient-mat-based method can describe more types of joint rotations, and the effectiveness of this method was verified by capturing hand movements of several participants. Thus it is recommended for measuring joint rotation angles in practical setups.

An Analysis Of Freestyle Swimming Technique on Students the Physical Education, Health And Leisure Study Program

The purpose of the study. The purpose of this study is to describe the technique of freestyle swimming in terms of: body position, hand movements, foot movements, breath taking movements and movement coordination. Materials and methods. Determine the level of mastery of the freestyle swimming technique in the students of the Physical Education Study Program at the Universitas Pahlawan who attend basic swimming lectures. Is it classified as very good, good, less or less. This research is descriptive, the population of this research is 20 students. Results. the level of mastery of technique on the body position indicator is 66% and the error rate is 34%, then the hand rotation indicator is 66 % and the error rate is 34%, then the foot movement indicator (Kicking) is 70% and the error rate is 30%. Furthermore, the level of mastery of techniques in breathing (breating) is 68.5% and the error rate is 30%, then the level of mastery of techniques in coordination is 68.5% and the error rate is 31.5%. Conclusions. Concluded that the level of mastery of technique on each indicator of the freestyle swimming technique

Human Muscle Synergy Analysis to Approach the Understanding of Brain Control Algorithm

Purpose: Muscle synergy is a functional unit that coordinates the activity of a number of muscles. In this study, the extraction of muscle synergies in three types of hand movements in the horizontal plane is investigated. Materials and Methods: So, after constructing the tracking pattern of three signals, by LabVIEW, the Electromyography (EMG) signal from six muscles of hand was recorded. Then time-constant muscle synergies and their activity curves from the recorded EMG signals were extracted using Non-negative Matrix Factorization (NMF) method. Results: Comparison of these patterns showed that the non-random motions’ synergies were more similar than the random motions among different individuals. It was observed that in all movements, the similarity of the synergies in one cluster was greater than the similarity of their corresponding activation curves. Conclusion: The results showed that the complexity of the recurrence plot in random movement is greater than that of the other movements.

Precision Medicine in Aortic Anastomosis: A Numerical and Experimental Study of a Novel Double-Sided Needle

Background: Hand-sewn anastomosis is a crucial part of aortic reconstruction surgery and significantly affects its outcome. The present study presents a novel, bidirectional surgical needle aimed to improve aortic anastomosis in terms of speed and ease of use. Our objective was to assess the efficacy of the new design in comparison with the conventional needle. Methods: A series of simulations were conducted with COMSOL software in order to perform a fatigue comparative analysis between the new and the conventional needle design. Ease of penetration into a piece of polydimethylsiloxane was evaluated. Lastly, the prototype was tested under in-vitro conditions in comparison with the conventional needle. Results: Based on fatigue analysis, the new needle design improves durability, provided the two tips are equally used. The polytetrafluoroethylene coating improves penetration into the tissue by 7% to 17%, while electropolishing improves penetration up to 19%. When using the novel needle design, the average anastomotic task completion time was significantly reduced by 22% and the overall distance of hand movements was significantly reduced by 20%. Conclusions: The proposed design exhibited a shorter anastomotic time and seems promising in relation to ease of use and simplicity of the anastomotic technique it introduces.

Computer control in human-machine interaction systems by hand movements

Computers have become popular in recent years. The forms of human-computer interaction are increasingly diverse. In many cases, controlling the computer is not only through the mouse and keyboard, but humans must control the computer through body language and representation. For some people with physical disabilities, controlling the computer through hand movements is essential to help them interact with the computer. The field of simulation also needs these interactive applications. This paper studies a solution to build a hand tracking and gesture recognition system that allows cursor movement and corresponding actions with mouse and keyboard. The research team confirms that the system works stably, accurately and can control the computer instead of a conventional mouse and keyboard through the implementation and evaluation.

Functional and diagnostic significance of the fMRI-response type to motor loads in patients after traumatic brain damage

Aim of the study. Clarification of the functional and diagnostic significance of topography, or the type of fMRI-response recorded during active and passive hand movements in patients after traumatic brain injury.Material and methods. fMRI-responses gained during active and passive hand movements were analyzed in 40 patients with posttraumatic motor function disturbances and compared with results gained from 17 healthy volunteers (control group ).Results. In analyzed patients the increase of percentage of diffuse fMRI-response has been shown along with the areas of activation not typical for movement activation pattern typical healthy volunteers. The fMRI response type being it local or multifocal does not clearly correlate with the presence of motor function impairment (hemiparesis). However, it was found that with greater severity of hemiparesis there is a larger percentage of multifocal fMRI-response.The transition from a multifocal form of a motor fMRI-response to a local one observed in a dynamic study is accompanied by an improvement of patient’s general condition, a shift towards normalization of a number of morphofunctional indicators of the central nervous system, the tendency of regression of motor disorders.Conclusion. The increase of multifocal fMRI-responses in patients after traumatic brain injury is one of the signs of cerebral dysfunction. Dynamically observed transformation from multifocal to local fMRI-responses is associated with current or long-term improvement in motor activity as well, wit the regression of other clinical impairments and can be considered as prognostically positive sign of the course of post-traumatic illness.

Ultra-Low Power Hand Gesture Sensor Using Electrostatic Induction

This paper presents an ultra-low power hand gesture sensor using electrostatic induction for mobile devices. Two electrodes, which consist of electret foils stacked on metal sheets, are used to recognize two gestures such as hand movements from left to right and right to left. The hand gesture recognition is realized by detecting the electrostatic induction currents induced by hand movements. However, the electrostatic induction currents are significantly small; hence, a hand gesture recognition chip is first designed in this study to amplify and detect the small electrostatic induction currents with low power. This chip is fabricated in a commercial 180 nm complementary metal oxide semiconductor (CMOS) process, and the measurement results indicate that the fabricated gesture recognition chip consumes 406 nW, which is less than 1/100th of the power dissipation of conventional gesture sensors.