scholarly journals ROAD SIGNS DETECTION AND RECOGNITION UTILIZING IMAGES AND 3D POINT CLOUD ACQUIRED BY MOBILE MAPPING SYSTEM

Author(s):  
Y. H. Li ◽  
T. Shinohara ◽  
T. Satoh ◽  
K. Tachibana

High-definition and highly accurate road maps are necessary for the realization of automated driving, and road signs are among the most important element in the road map. Therefore, a technique is necessary which can acquire information about all kinds of road signs automatically and efficiently. Due to the continuous technical advancement of Mobile Mapping System (MMS), it has become possible to acquire large number of images and 3d point cloud efficiently with highly precise position information. In this paper, we present an automatic road sign detection and recognition approach utilizing both images and 3D point cloud acquired by MMS. The proposed approach consists of three stages: 1) detection of road signs from images based on their color and shape features using object based image analysis method, 2) filtering out of over detected candidates utilizing size and position information estimated from 3D point cloud, region of candidates and camera information, and 3) road sign recognition using template matching method after shape normalization. The effectiveness of proposed approach was evaluated by testing dataset, acquired from more than 180 km of different types of roads in Japan. The results show a very high success in detection and recognition of road signs, even under the challenging conditions such as discoloration, deformation and in spite of partial occlusions.

Author(s):  
Y. H. Li ◽  
T. Shinohara ◽  
T. Satoh ◽  
K. Tachibana

High-definition and highly accurate road maps are necessary for the realization of automated driving, and road signs are among the most important element in the road map. Therefore, a technique is necessary which can acquire information about all kinds of road signs automatically and efficiently. Due to the continuous technical advancement of Mobile Mapping System (MMS), it has become possible to acquire large number of images and 3d point cloud efficiently with highly precise position information. In this paper, we present an automatic road sign detection and recognition approach utilizing both images and 3D point cloud acquired by MMS. The proposed approach consists of three stages: 1) detection of road signs from images based on their color and shape features using object based image analysis method, 2) filtering out of over detected candidates utilizing size and position information estimated from 3D point cloud, region of candidates and camera information, and 3) road sign recognition using template matching method after shape normalization. The effectiveness of proposed approach was evaluated by testing dataset, acquired from more than 180 km of different types of roads in Japan. The results show a very high success in detection and recognition of road signs, even under the challenging conditions such as discoloration, deformation and in spite of partial occlusions.


Author(s):  
E. Barçon ◽  
A. Picard

Abstract. Surveys of roadways with Mobile Laser Scanning (MLS) are nowadays the faster and more secured way to collect topographic data compared with conventional techniques. To deliver topographic plans, the voluminous data collected by the MLS device need to be processed. If the acquisition step is quite fast, the second part of interpretation and vectorization of the LiDAR data and the panoramic images is laborious and time consuming. This paper proposes two approaches that have been developed in order to reduce the time required to process roadway MLS data. The first one is about automatic detection of pole like objects, and the second one is about the detection of linear objects. The presented workflow try to automatically extract a 3D position for each object from MLS Data.


Author(s):  
M. Soilán ◽  
B. Riveiro ◽  
J. Martínez-Sánchez ◽  
P. Arias

The periodic inspection of certain infrastructure features plays a key role for road network safety and preservation, and for developing optimal maintenance planning that minimize the life-cycle cost of the inspected features. Mobile Mapping Systems (MMS) use laser scanner technology in order to collect dense and precise three-dimensional point clouds that gather both geometric and radiometric information of the road network. Furthermore, time-stamped RGB imagery that is synchronized with the MMS trajectory is also available. In this paper a methodology for the automatic detection and classification of road signs from point cloud and imagery data provided by a LYNX Mobile Mapper System is presented. First, road signs are detected in the point cloud. Subsequently, the inventory is enriched with geometrical and contextual data such as orientation or distance to the trajectory. Finally, semantic content is given to the detected road signs. As point cloud resolution is insufficient, RGB imagery is used projecting the 3D points in the corresponding images and analysing the RGB data within the bounding box defined by the projected points. The methodology was tested in urban and road environments in Spain, obtaining global recall results greater than 95%, and F-score greater than 90%. In this way, inventory data is obtained in a fast, reliable manner, and it can be applied to improve the maintenance planning of the road network, or to feed a Spatial Information System (SIS), thus, road sign information can be available to be used in a Smart City context.


Author(s):  
Árpád Barsi ◽  
Vivien Potó ◽  
János Máté Lógó ◽  
Nikol Krausz

The development of automotive technologies requires quite a significant amount of time and money. To accelerate this procedure, the technology of now is strongly based on computer simulations, where the whole vehicle or its parts can be analyzed in a virtual environment. The behavior of cars, especially equipped with new sensors or assistants, requires long testing, where the automotive simulators can play a cardinal role. The precise vehicular tests request accurate environmental models. These new kinds of models are still standardized; one of the pioneer de facto standards is OpenDRIVE. This standard was initially defined to be able to express all elements with all potential parameters required in high precision simulations. The actual research focused on creating a compliant virtual model based on mobile mapping measurements. A Leica Pegasus Two mobile mapping system was applied to capture field data about the selected pilot area, which is the campus of Budapest University of Technology and Economics (BME). The obtained Lidar point cloud was georeferenced; the merged point cloud is tailored to the driven trajectory, and then it has been evaluated manually. The acquired land use map is converted – similarly manually – into basic road geometry elements: straight lane and bended lane segments. These objects are finally compiled into an XML format, which is compliant with the OpenDRIVE standard. The achieved virtual model has been tested in Driving Scenario Designer of Mathworks Matlab; however, it is promptly ready for use in other widely applied automotive simulators.


Author(s):  
M. Nakagawa ◽  
T. Yamamoto ◽  
S. Tanaka ◽  
M. Shiozaki ◽  
T. Ohhashi

We focus on a region-based point clustering to extract a polygon from a massive point cloud. In the region-based clustering, RANSAC is a suitable approach for estimating surfaces. However, local workspace selection is required to improve a performance in a surface estimation from a massive point cloud. Moreover, the conventional RANSAC is hard to determine whether a point lies inside or outside a surface. In this paper, we propose a method for panoramic rendering-based polygon extraction from indoor mobile LiDAR data. Our aim was to improve region-based point cloud clustering in modeling after point cloud registration. First, we propose a point cloud clustering methodology for polygon extraction on a panoramic range image generated with point-based rendering from a massive point cloud. Next, we describe an experiment that was conducted to verify our methodology with an indoor mobile mapping system in an indoor environment. This experiment was wall-surface extraction using a rendered point cloud from some viewpoints over a wide indoor area. Finally, we confirmed that our proposed methodology could achieve polygon extraction through point cloud clustering from a complex indoor environment.


2021 ◽  
Vol 13 (7) ◽  
pp. 1252
Author(s):  
Luis Javier Sánchez-Aparicio ◽  
Rocío Mora ◽  
Borja Conde ◽  
Miguel Ángel Maté-González ◽  
María Sánchez-Aparicio ◽  
...  

This work aims at enhancing the current methodologies used for generating as-built CAD models suitable for advanced numerical simulations. To this end, this paper proposes the use of a wearable mobile mapping system that allows one to improve the digitalization stage in terms of flexibility and time required. The noise showed by the resulting point cloud, based on the simultaneous location and mapping (SLAM) solution, demands a post-processing stage that introduces the use of a parameter-free noise reduction filter. This filter improves the quality of the point cloud, allowing for the adjustment of surfaces by means of parametric and non-parametric shapes. These shapes are created by using reverse engineering procedures. The results showed during this investigation highlight a novel application of this sensor: the creation of as-built CAD models for advanced numerical simulations. The results of this investigation are complemented by a valuable contribution with respect to the use of an advanced restoration solution, by means of textile reinforced mortar. To this end, the CAD model is used as the geometrical base for several numerical simulations by means of the finite element method. All this procedure is applied in a construction with structural problems.


Sign in / Sign up

Export Citation Format

Share Document