Color-based video stabilization for real-time on-board object detection on high-speed trains

Author(s):  
S. Piva ◽  
M. Zara ◽  
G. Gera ◽  
C.S. Regazzoni
Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5279
Author(s):  
Dong-Hoon Kwak ◽  
Guk-Jin Son ◽  
Mi-Kyung Park ◽  
Young-Duk Kim

The consumption of seaweed is increasing year by year worldwide. Therefore, the foreign object inspection of seaweed is becoming increasingly important. Seaweed is mixed with various materials such as laver and sargassum fusiforme. So it has various colors even in the same seaweed. In addition, the surface is uneven and greasy, causing diffuse reflections frequently. For these reasons, it is difficult to detect foreign objects in seaweed, so the accuracy of conventional foreign object detectors used in real manufacturing sites is less than 80%. Supporting real-time inspection should also be considered when inspecting foreign objects. Since seaweed requires mass production, rapid inspection is essential. However, hyperspectral imaging techniques are generally not suitable for high-speed inspection. In this study, we overcome this limitation by using dimensionality reduction and using simplified operations. For accuracy improvement, the proposed algorithm is carried out in 2 stages. Firstly, the subtraction method is used to clearly distinguish seaweed and conveyor belts, and also detect some relatively easy to detect foreign objects. Secondly, a standardization inspection is performed based on the result of the subtraction method. During this process, the proposed scheme adopts simplified and burdenless calculations such as subtraction, division, and one-by-one matching, which achieves both accuracy and low latency performance. In the experiment to evaluate the performance, 60 normal seaweeds and 60 seaweeds containing foreign objects were used, and the accuracy of the proposed algorithm is 95%. Finally, by implementing the proposed algorithm as a foreign object detection platform, it was confirmed that real-time operation in rapid inspection was possible, and the possibility of deployment in real manufacturing sites was confirmed.


2017 ◽  
Vol 28 (10) ◽  
pp. 1750126 ◽  
Author(s):  
Yutong Liu ◽  
Chengxuan Cao ◽  
Yaling Zhou ◽  
Ziyan Feng

In this paper, an improved real-time control model based on the discrete-time method is constructed to control and simulate the movement of high-speed trains on large-scale rail network. The constraints of acceleration and deceleration are introduced in this model, and a more reasonable definition of the minimal headway is also presented. Considering the complicated rail traffic environment in practice, we propose a set of sound operational strategies to excellently control traffic flow on rail network under various conditions. Several simulation experiments with different parameter combinations are conducted to verify the effectiveness of the control simulation method. The experimental results are similar to realistic environment and some characteristics of rail traffic flow are also investigated, especially the impact of stochastic disturbances and the minimal headway on the rail traffic flow on large-scale rail network, which can better assist dispatchers in analysis and decision-making. Meanwhile, experimental results also demonstrate that the proposed control simulation method can be in real-time control of traffic flow for high-speed trains not only on the simple rail line, but also on the complicated large-scale network such as China’s high-speed rail network and serve as a tool of simulating the traffic flow on large-scale rail network to study the characteristics of rail traffic flow.


Author(s):  
Zhaijun Lu ◽  
Weijia Huang ◽  
Mu Zhong ◽  
Dongrun Liu ◽  
Tian Li ◽  
...  

Real-time monitoring of overturning coefficients is very important for ensuring the safety of high-speed trains passing through complex terrain sections under strong wind conditions. In recent years, the phenomenon of “car swaying” that occurs when trains pass through the complex terrain has brought new challenges to ensuring the safety and riding comfort of passengers. In China, more and more high-speed trains are facing strong wind environments when running in complex terrain sections. However, due to the limitation of objective conditions, so far, only a few economical and effective methods of measurement have been developed that are suitable for real-time monitoring of the overturning coefficient of commercial vehicles. Therefore, considering the applicability and universality of such a monitoring method, this study presents a method for measuring the overturning coefficient of trains using the primary suspension system under strong winds. A vehicle test was carried out to verify the accuracy of the method. The results show that after correction, the overturning coefficient obtained from the primary suspension system is generally consistent with the overturning coefficient obtained from the instrumented wheelset. The method of measuring the overturning coefficient of trains in strong wind environments with the primary suspension system is, thus, proven feasible.


2019 ◽  
Vol 6 (1) ◽  
Author(s):  
Sushil Raut ◽  
Kohei Shimasaki ◽  
Sanjay Singh ◽  
Takeshi Takaki ◽  
Idaku Ishii

AbstractIn this study, the novel approach of real-time video stabilization system using a high-frame-rate (HFR) jitter sensing device is demonstrated to realize the computationally efficient technique of digital video stabilization for high-resolution image sequences. This system consists of a high-speed camera to extract and track feature points in gray-level $$512\times 496$$512×496 image sequences at 1000 fps and a high-resolution CMOS camera to capture $$2048\times 2048$$2048×2048 image sequences considering their hybridization to achieve real-time stabilization. The high-speed camera functions as a real-time HFR jitter sensing device to measure an apparent jitter movement of the system by considering two ways of computational acceleration; (1) feature point extraction with a parallel processing circuit module of the Harris corner detection and (2) corresponding hundreds of feature points at the current frame to those in the neighbor ranges at the previous frame on the assumption of small frame-to-frame displacement in high-speed vision. The proposed hybrid-camera system can digitally stabilize the $$2048\times 2048$$2048×2048 images captured with the high-resolution CMOS camera by compensating the sensed jitter-displacement in real time for displaying to human eyes on a computer display. The experiments were conducted to demonstrate the effectiveness of hybrid-camera-based digital video stabilization such as (a) verification when the hybrid-camera system in the pan direction in front of a checkered pattern, (b) stabilization in video shooting a photographic pattern when the system moved with a mixed-displacement motion of jitter and constant low-velocity in the pan direction, and (c) stabilization in video shooting a real-world outdoor scene when an operator holding hand-held hybrid-camera module while walking on the stairs.


2020 ◽  
Vol 17 (3) ◽  
pp. 172988142093271
Author(s):  
Xiali Li ◽  
Manjun Tian ◽  
Shihan Kong ◽  
Licheng Wu ◽  
Junzhi Yu

To tackle the water surface pollution problem, a vision-based water surface garbage capture robot has been developed in our lab. In this article, we present a modified you only look once v3-based garbage detection method, allowing real-time and high-precision object detection in dynamic aquatic environments. More specifically, to improve the real-time detection performance, the detection scales of you only look once v3 are simplified from 3 to 2. Besides, to guarantee the accuracy of detection, the anchor boxes of our training data set are reclustered for replacing some of the original you only look once v3 prior anchor boxes that are not appropriate to our data set. By virtue of the proposed detection method, the capture robot has the capability of cleaning floating garbage in the field. Experimental results demonstrate that both detection speed and accuracy of the modified you only look once v3 are better than those of other object detection algorithms. The obtained results provide valuable insight into the high-speed detection and grasping of dynamic objects in complex aquatic environments autonomously and intelligently.


2020 ◽  
Vol 49 (5) ◽  
pp. 20190553
Author(s):  
李鸿龙 Honglong Li ◽  
杨杰 Jie Yang ◽  
张忠星 Zhongxing Zhang ◽  
罗迁 Qian Luo ◽  
于双铭 Shuangming Yu ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document