Exploring Silent Speech Interfaces Based on Frequency-Modulated Continuous-Wave Radar

Speech is our most natural and efficient form of communication and offers a strong potential to improve how we interact with machines. However, speech communication can sometimes be limited by environmental (e.g., ambient noise), contextual (e.g., need for privacy), or health conditions (e.g., laryngectomy), preventing the consideration of audible speech. In this regard, silent speech interfaces (SSI) have been proposed as an alternative, considering technologies that do not require the production of acoustic signals (e.g., electromyography and video). Unfortunately, despite their plentitude, many still face limitations regarding their everyday use, e.g., being intrusive, non-portable, or raising technical (e.g., lighting conditions for video) or privacy concerns. In line with this necessity, this article explores the consideration of contactless continuous-wave radar to assess its potential for SSI development. A corpus of 13 European Portuguese words was acquired for four speakers and three of them enrolled in a second acquisition session, three months later. Regarding the speaker-dependent models, trained and tested with data from each speaker while using 5-fold cross-validation, average accuracies of 84.50% and 88.00% were respectively obtained from Bagging (BAG) and Linear Regression (LR) classifiers, respectively. Additionally, recognition accuracies of 81.79% and 81.80% were also, respectively, achieved for the session and speaker-independent experiments, establishing promising grounds for further exploring this technology towards silent speech recognition.

Railway Track Recognition Based on Radar Cross-Section Statistical Characterization Using mmWave Radar

The track settlement has a great influence on the safe operation of high-speed trains. The existing track settlement measurement approach requires sophisticated or expensive equipments, and the real-time performance is limited. To address the issue, an ultra-high resolution track settlement detection method is proposed by using millimeter wave radar based on frequency modulated continuous wave (FMCW). Firstly, by constructing the RCS statistical feature data set of multiple objects in the track settlement measurement environment, a directed acyclic graph-support vector machine (DAG-SVM) based method is designed to solve the problem of track recognition in multi-object scenes. Then, the adaptive chirp-z-transform (ACZT) algorithm is used to estimate the distance between the radar and the track surface, which realizes automatic real-time track settlement detection. An experimental platform has been constructed to verify the effectiveness of the proposed method. The experimental results show that the accuracy of track classification and identification is at least 95%, and the accuracy of track settlement measurement exceeds 0.5 mm, which completely meets the accuracy requirements of the railway system.

Матричное радиовидение на основе гетеродинного приема с применением радиолокации непрерывным излучением

A new approach to the creation of millimeter-wave radio imaging systems is proposed. This approach is based on the use of an array receiver consisting of a densely packed (pixel size - 4 mm) array of planar mixers located in the focal plane of a quasi-optical objective, with application of the frequency-modulated continuous-wave radar technique. It has been demonstrated that the implementation of the heterodyne type of reception makes it possible to increase the distance range of the array radio imaging system up to ~ 100 m while maintaining the angular resolution at the previous level.

Radar as a Key to Global Aeroecology

Open, systematic, and global approaches are needed to address the challenges of aeroconservation and pest management. Recent technical progress enables deeper investigation and understanding of aeroecology. Radar plays a central role in flying species monitoring in the global scope. The technology provides various ways of target detection and tracking, working for multiple ranges and different visibility. The existing technology allows deploying global monitoring of avian and insect species. This work discusses the essentials of the technology and the history of its application for bird and insect detection. The author describes the development of the topic according to the main groups of radar approaches: pulsed sets, vertical-looking solutions, harmonic systems, and efficient frequency modulated continuous wave radar. Advances in big data processing, robotics, computation, and communications enable practitioners to combine the discussed radar solutions aiming at global avian and insect biodiversity monitoring and negative human impact systematic estimation.

A Non-Invasive Millimetre-Wave Radar Sensor for Automated Behavioural Tracking in Precision Farming—Application to Sheep Husbandry

The automated quantification of the behaviour of freely moving animals is increasingly needed in applied ethology. State-of-the-art approaches often require tags to identify animals, high computational power for data collection and processing, and are sensitive to environmental conditions, which limits their large-scale utilization, for instance in genetic selection programs of animal breeding. Here we introduce a new automated tracking system based on millimetre-wave radars for real time robust and high precision monitoring of untagged animals. In contrast to conventional video tracking systems, radar tracking requires low processing power, is independent on light variations and has more accurate estimations of animal positions due to a lower misdetection rate. To validate our approach, we monitored the movements of 58 sheep in a standard indoor behavioural test used for assessing social motivation. We derived new estimators from the radar data that can be used to improve the behavioural phenotyping of the sheep. We then showed how radars can be used for movement tracking at larger spatial scales, in the field, by adjusting operating frequency and radiated electromagnetic power. Millimetre-wave radars thus hold considerable promises precision farming through high-throughput recording of the behaviour of untagged animals in different types of environments.

Recognition of flying small target based on enhanced quadratic time-frequency analysis

UAVs (Unmanned Aerial Vehicles, UAVs) are flying targets that sail at low altitudes, are slower and smaller in size. Nowadays, the task of detecting and distinguishing flying small targets is very difficult, so how to efficiently recognize flying small targets in real time is a key issue of current research. In order to solve this problem, this paper proposes a method of using pseudo-WVD and image fusion to represent the characteristics of UAVs. First, the SMMWR (Single-mode millimeter wave radar, SMMWR) equipment is used to collect the echo signals of various types of UAVs, and at the same time, the two-dimensional FFT is used to extract the target micro-motion signals in the distance dimension. Secondly, PWVD is used to generate time-frequency graphs of different window functions. Finally, the images fused based on principal component analysis are sent to AlexNet for training. The result proves that the accuracy of recognition rate based on AlexNet can be 93.75%.

Silent Speech Command Word Recognition Using Stepped Frequency Continuous Wave Radar

Recovering speech in the absence of the acoustic speech signal itself, i.e., silent speech, holds great potential for restoring or enhancing oral communication in those who lost it. Radar is a relatively unexplored silent speech sensing modality, even though it has the advantage of being fully non-invasive. We therefore built a custom stepped frequency continuous wave radar hardware to measure the changes in the transmission spectra during speech between three antennas, located on both cheeks and the chin with a measuring frequency of 100 Hz. We then recorded a command word corpus of 40 phonetically balanced, two-syllable German words and the German digits zero to nine for two individual speakers and evaluated both the speaker-dependent multi-session and inter-session recognition accuracies on this 50-word corpus using a bidirectional long-short term memory network. We obtained recognition accuracies of 99.17 % and 88.87 % for the speaker-dependent multi-session and inter-session accuracy, respectively. These results show that the transmission spectra are very well suited to discriminate individual words from one another, even across different sessions, which is one of the key challenges for fully non-invasive silent speech interfaces.

Low-Complexity 2D-MUSIC for Joint Range and Angle Estimation of Frequency Modulated Continuous-Wave Radar

A pre-processing technique is proposed to reduce the complexity of two-dimensional multiple signal classification (2D-MUSIC) for the joint range and angle estimation of frequency-modulated continuous-wave (FMCW) radar systems. By using the central symmetry of the angle steering vector from a uniform linear array (ULA) antenna and the linearity of the beat signal in the FMCW radar, this preprocessing technique transforms 2D-MUSIC from complex values into real values. To compare the computational complexity of the proposed algorithm with the conventional 2D-MUSIC, we measured the CPU processing time for various numbers of snapshots, and the evaluation results indicated that the 2D-MUSIC with the proposed pre-processing technique is approximately three times faster than the conventional 2D-MUSIC.