An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation

2022 ◽  
Vol 73 ◽  
pp. 102258
Author(s):  
Sung Ho Choi ◽  
Kyeong-Beom Park ◽  
Dong Hyeon Roh ◽  
Jae Yeol Lee ◽  
Mustafa Mohammed ◽  
...  
Impact ◽  
2020 ◽  
Vol 2020 (2) ◽  
pp. 9-11
Author(s):  
Tomohiro Fukuda

Mixed reality (MR) is rapidly becoming a vital tool, not just in gaming, but also in education, medicine, construction and environmental management. The term refers to systems in which computer-generated content is superimposed over objects in a real-world environment across one or more sensory modalities. Although most of us have heard of the use of MR in computer games, it also has applications in military and aviation training, as well as tourism, healthcare and more. In addition, it has the potential for use in architecture and design, where buildings can be superimposed in existing locations to render 3D generations of plans. However, one major challenge that remains in MR development is the issue of real-time occlusion. This refers to hiding 3D virtual objects behind real articles. Dr Tomohiro Fukuda, who is based at the Division of Sustainable Energy and Environmental Engineering, Graduate School of Engineering at Osaka University in Japan, is an expert in this field. Researchers, led by Dr Tomohiro Fukuda, are tackling the issue of occlusion in MR. They are currently developing a MR system that realises real-time occlusion by harnessing deep learning to achieve an outdoor landscape design simulation using a semantic segmentation technique. This methodology can be used to automatically estimate the visual environment prior to and after construction projects.


Author(s):  
Hossein Ahmadian, Ph.D. ◽  
Prasath Mageswaren ◽  
Dukagjin Blakaj ◽  
Ehud Mendel ◽  
Soheil Soghrati ◽  
...  

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Samad M.E. Sepasgozar ◽  
Mohsen Ghobadi ◽  
Sara Shirowzhan ◽  
David J. Edwards ◽  
Elham Delzendeh

PurposeThis paper aims to examine the current technology acceptance model (TAM) in the field of mixed reality and digital twin (MRDT) and identify key factors affecting users' intentions to use MRDT. The factors are used as a set of key metrics for proposing a predictive model for virtual, augmented and mixed reality (MR) acceptance by users. This model is called the extended TAM for MRDT adoption in the architecture, engineering, construction and operations (AECO) industry.Design/methodology/approachAn interpretivist philosophical lens was adopted to conduct an inductive systematic and bibliographical analysis of secondary data contained within published journal articles that focused upon MRDT acceptance modelling. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) approach to meta-analysis were adopted to ensure all key investigations were included in the final database set. Quantity indicators such as path coefficients, factor ranking, Cronbach’s alpha (a) and chi-square (b) test, coupled with content analysis, were used for examining the database constructed. The database included journal papers from 2010 to 2020.FindingsThe extant literature revealed that the most commonly used constructs of the MRDT–TAM included: subjective norm; social influence; perceived ease of use (PEOU); perceived security; perceived enjoyment; satisfaction; perceived usefulness (PU); attitude; and behavioural intention (BI). Using these identified constructs, the general extended TAM for MRDT in the AECO industry is developed. Other important factors such as “perceived immersion” could be added to the obtained model.Research limitations/implicationsThe decision to utilise a new technology is difficult and high risk in the construction project context, due to the complexity of MRDT technologies and dynamic construction environment. The outcome of the decision may affect employee performance, project productivity and on-site safety. The extended acceptance model offers a set of factors that assist managers or practitioners in making effective decisions for utilising any type of MRDT technology.Practical implicationsSeveral constraints are apparent due to the limited investigation of MRDT evaluation matrices and empirical studies. For example, the research only covers technologies which have been reported in the literature, relating to virtual reality (VR), augmented reality (AR), MR, DT and sensors, so newer technologies may not be included. Moreover, the review process could span a longer time period and thus embrace a fuller spectrum of technology development in these different areas.Originality/valueThe research provides a theoretical model for measuring and evaluating MRDT acceptance at the individual level in the AECO context and signposts future research related to MRDT adoption in the AECO industry, as well as providing managerial guidance for progressive AECO professionals who seek to expand their use of MRDT in the Fourth Industrial Revolution (4IR). A set of key factors affecting MRDT acceptance is identified which will help innovators to improve their technology to achieve a wider acceptance.


Author(s):  
Hyung-Il Kim ◽  
Taehei Kim ◽  
Eunhwa Song ◽  
Seo Young Oh ◽  
Dooyoung Kim ◽  
...  

2021 ◽  
pp. 239-251
Author(s):  
Nicolás Duque-Suárez ◽  
Lina María Amaya-Mejía ◽  
Carol Martinez ◽  
Daniel Jaramillo-Ramirez

Procedia CIRP ◽  
2018 ◽  
Vol 72 ◽  
pp. 3-8 ◽  
Author(s):  
Hongyi Liu ◽  
Tongtong Fang ◽  
Tianyu Zhou ◽  
Yuquan Wang ◽  
Lihui Wang

CIRP Annals ◽  
2020 ◽  
Vol 69 (1) ◽  
pp. 369-372
Author(s):  
Pasquale Franciosa ◽  
Mikhail Sokolov ◽  
Sumit Sinha ◽  
Tianzhu Sun ◽  
Dariusz Ceglarek

Sign in / Sign up

Export Citation Format

Share Document