scholarly journals Wearable Augmented Reality Application for Shoulder Rehabilitation

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1178 ◽  
Author(s):  
Sara Condino ◽  
Giuseppe Turini ◽  
Rosanna Viglialoro ◽  
Marco Gesi ◽  
Vincenzo Ferrari
Keyword(s):  
Augmented Reality ◽  
Frame Rate ◽  
Markerless Tracking ◽  
Head Mounted Displays ◽  
Target Frame ◽  
Microsoft Hololens ◽  
Technical Features ◽  
Wearable Augmented Reality ◽  
Real Patients ◽  
Rehabilitation Exercise

Augmented reality (AR) technology is gaining popularity and scholarly interest in the rehabilitation sector because of the possibility to generate controlled, user-specific environmental and perceptual stimuli which motivate the patient, while still preserving the possibility to interact with the real environment and other subjects, including the rehabilitation specialist. The paper presents the first wearable AR application for shoulder rehabilitation, based on Microsoft HoloLens, with real-time markerless tracking of the user’s hand. Potentialities and current limits of commercial head-mounted displays (HMDs) are described for the target medical field, and details of the proposed application are reported. A serious game was designed starting from the analysis of a traditional rehabilitation exercise, taking into account HoloLens specifications to maximize user comfort during the AR rehabilitation session. The AR application implemented consistently meets the recommended target frame rate for immersive applications with HoloLens device: 60 fps. Moreover, the ergonomics and the motivational value of the proposed application were positively evaluated by a group of five rehabilitation specialists and 20 healthy subjects. Even if a larger study, including real patients, is necessary for a clinical validation of the proposed application, the results obtained encourage further investigations and the integration of additional technical features for the proposed AR application.

scholarly journals ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2234
Author(s):  
Sebastian Kapp ◽  
Michael Barz ◽  
Sergey Mukhametov ◽  
Daniel Sonntag ◽  
Jochen Kuhn
Keyword(s):  
Augmented Reality ◽  
Eye Tracking ◽  
User Interaction ◽  
R Package ◽  
Eye Tracker ◽  
Unity 3D ◽  
Accuracy And Precision ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Microsoft Hololens

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.

A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens

2020 ◽  
Vol 49 (1) ◽  
pp. 287-298
Author(s):  
Peng Liu ◽  
Chenmeng Li ◽  
Changlin Xiao ◽  
Zeshu Zhang ◽  
Junqi Ma ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Navigation System ◽  
Microsoft Hololens ◽  
Wearable Augmented Reality

scholarly journals WozARd: A Wizard of Oz Method for Wearable Augmented Reality Interaction—A Pilot Study

2015 ◽  
Vol 2015 ◽  
pp. 1-10 ◽  
Author(s):  
Günter Alce ◽  
Mattias Wallergård ◽  
Klas Hermodsson
Keyword(s):  
Pilot Study ◽  
Augmented Reality ◽  
User Interfaces ◽  
Wearable Devices ◽  
Human Operator ◽  
Wizard Of Oz ◽  
Qualitative And Quantitative ◽  
Head Mounted Displays ◽  
Wearable Augmented Reality ◽  
General User

Head-mounted displays and other wearable devices open up for innovative types of interaction for wearable augmented reality (AR). However, to design and evaluate these new types of AR user interfaces, it is essential to quickly simulate undeveloped components of the system and collect feedback from potential users early in the design process. One way of doing this is the wizard of Oz (WOZ) method. The basic idea behind WOZ is to create the illusion of a working system by having a human operator, performing some or all of the system’s functions. WozARd is a WOZ method developed for wearable AR interaction. The presented pilot study was an initial investigation of the capability of the WozARd method to simulate an AR city tour. Qualitative and quantitative data were collected from 21 participants performing a simulated AR city tour. The data analysis focused on seven categories that can have an impact on how the WozARd method is perceived by participants: precision, relevance, responsiveness, technical stability, visual fidelity, general user-experience, and human-operator performance. Overall, the results indicate that the participants perceived the simulated AR city tour as a relatively realistic experience despite a certain degree of technical instability and human-operator mistakes.

Demonstration: Virtual Patient Immersive Trainer to Train Perceptual Skills Using Augmented Reality

2020 ◽  
Vol 64 (1) ◽  
pp. 470-472
Author(s):  
Christen E. Sushereba ◽  
Laura G. Militello
Keyword(s):  
Medical Students ◽  
Augmented Reality ◽  
Student Performance ◽  
Group Interaction ◽  
Virtual Patient ◽  
Perceptual Cues ◽  
Perceptual Skills ◽  
Individual Interaction ◽  
Severity Of Injury ◽  
Microsoft Hololens

In this session, we will demonstrate the Virtual Patient Immersive Trainer (VPIT). The VPIT system uses augmented reality (AR) to allow medics and medical students to experience a photorealistic, life-sized virtual patient. The VPIT supports learners in obtaining the perceptual skills required to recognize and interpret subtle perceptual cues critical to assessing a patient’s condition. We will conduct an interactive demonstration of the virtual patient using both a tablet (for group interaction) and an AR-enabled headset (Microsoft HoloLens) for individual interaction. In addition, we will demonstrate use of the instructor tablet to control what the learner sees (e.g., injury types, severity of injury) and to monitor student performance.

Estimating Distances in Action Space in Augmented Reality

2021 ◽  
Vol 18 (2) ◽  
pp. 1-16
Author(s):  
Holly C. Gagnon ◽  
Carlos Salas Rosales ◽  
Ryan Mileris ◽  
Jeanine K. Stefanucci ◽  
Sarah H. Creem-Regehr ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Distance Measure ◽  
Distance Perception ◽  
Action Space ◽  
Indoor Environments ◽  
Verbal Reports ◽  
Visual Matching ◽  
Microsoft Hololens ◽  
Real Person

Augmented reality ( AR ) is important for training complex tasks, such as navigation, assembly, and medical procedures. The effectiveness of such training may depend on accurate spatial localization of AR objects in the environment. This article presents two experiments that test egocentric distance perception in augmented reality within and at the boundaries of action space (up to 35 m) in comparison with distance perception in a matched real-world ( RW ) environment. Using the Microsoft HoloLens, in Experiment 1, participants in two different RW settings judged egocentric distances (ranging from 10 to 35 m) to an AR avatar or a real person using a visual matching measure. Distances to augmented targets were underestimated compared to real targets in the two indoor, RW contexts. Experiment 2 aimed to generalize the results to an absolute distance measure using verbal reports in one of the indoor environments. Similar to Experiment 1, distances to augmented targets were underestimated compared to real targets. We discuss these findings with respect to the importance of methodologies that directly compare performance in real and mediated environments, as well as the inherent differences present in mediated environments that are “matched” to the real world.

scholarly journals Use cases and usability challenges for head-mounted displays in healthcare

2015 ◽  
Vol 1 (1) ◽  
pp. 534-537 ◽  
Author(s):  
T. Mentler ◽  
C. Wolters ◽  
M. Herczeg
Keyword(s):  
Augmented Reality ◽  
Emergency Medical Services ◽  
Information Visualization ◽  
Nursing Staff ◽  
Interaction Design ◽  
Use Cases ◽  
Design Approach ◽  
User Centered Design ◽  
Head Mounted Displays ◽  
Mobile Context

AbstractIn the healthcare domain, head-mounted displays (HMDs) with augmented reality (AR) modalities have been reconsidered for application as a result of commercially available products and the needs for using computers in mobile context. Within a user-centered design approach, interviews were conducted with physicians, nursing staff and members of emergency medical services. Additionally practitioners were involved in evaluating two different head-mounted displays. Based on these measures, use cases and usability considerations according to interaction design and information visualization were derived and are described in this contribution.

Sign in / Sign up

Export Citation Format

Share Document