Sentiment Analysis of Participant Comments in a User Centered Design Study for Degraded Visual Environment Sensor Visualization

Author(s):  
Bradley M. Davis ◽  
Samineh C. Gillmore ◽  
Derek Millard

Several methodologies in user centered research lead to the collection of large amounts of comments about a product or system. The growth of social media research has led to the development of sentiment analysis algorithms that computationally analyze the meaning of text. This paper utilized the Valence Aware Dictionary for sEntiment Reasoning (VADER) sentiment analysis technique to assess comments from a user centered design study for a rotorcraft degraded visual environment mitigation system. The sentiment analysis findings mirror results from the other measures of the user centered design study. This paper supports the use of sentiment analysis for large volumes of comment data from user centered design studies.

2020 ◽  
Vol 26 (6) ◽  
pp. 2192-2203
Author(s):  
Yucong Ye ◽  
Franz Sauer ◽  
Kwan-Liu Ma ◽  
Konduri Aditya ◽  
Jacqueline Chen

10.2196/16862 ◽  
2020 ◽  
Vol 8 (8) ◽  
pp. e16862
Author(s):  
Curtis Lee Petersen ◽  
Ryan Halter ◽  
David Kotz ◽  
Lorie Loeb ◽  
Summer Cook ◽  
...  

Background Sarcopenia, defined as the age-associated loss of muscle mass and strength, can be effectively mitigated through resistance-based physical activity. With compliance at approximately 40% for home-based exercise prescriptions, implementing a remote sensing system would help patients and clinicians to better understand treatment progress and increase compliance. The inclusion of end users in the development of mobile apps for remote-sensing systems can ensure that they are both user friendly and facilitate compliance. With advancements in natural language processing (NLP), there is potential for these methods to be used with data collected through the user-centered design process. Objective This study aims to develop a mobile app for a novel device through a user-centered design process with both older adults and clinicians while exploring whether data collected through this process can be used in NLP and sentiment analysis Methods Through a user-centered design process, we conducted semistructured interviews during the development of a geriatric-friendly Bluetooth-connected resistance exercise band app. We interviewed patients and clinicians at weeks 0, 5, and 10 of the app development. Each semistructured interview consisted of heuristic evaluations, cognitive walkthroughs, and observations. We used the Bing sentiment library for a sentiment analysis of interview transcripts and then applied NLP-based latent Dirichlet allocation (LDA) topic modeling to identify differences and similarities in patient and clinician participant interviews. Sentiment was defined as the sum of positive and negative words (each word with a +1 or −1 value). To assess utility, we used quantitative assessment questionnaires—System Usability Scale (SUS) and Usefulness, Satisfaction, and Ease of use (USE). Finally, we used multivariate linear models—adjusting for age, sex, subject group (clinician vs patient), and development—to explore the association between sentiment analysis and SUS and USE outcomes. Results The mean age of the 22 participants was 68 (SD 14) years, and 17 (77%) were female. The overall mean SUS and USE scores were 66.4 (SD 13.6) and 41.3 (SD 15.2), respectively. Both patients and clinicians provided valuable insights into the needs of older adults when designing and building an app. The mean positive-negative sentiment per sentence was 0.19 (SD 0.21) and 0.47 (SD 0.21) for patient and clinician interviews, respectively. We found a positive association with positive sentiment in an interview and SUS score (ß=1.38; 95% CI 0.37 to 2.39; P=.01). There was no significant association between sentiment and the USE score. The LDA analysis found no overlap between patients and clinicians in the 8 identified topics. Conclusions Involving patients and clinicians allowed us to design and build an app that is user friendly for older adults while supporting compliance. This is the first analysis using NLP and usability questionnaires in the quantification of user-centered design of technology for older adults.


2018 ◽  
Vol 5 (2) ◽  
pp. 205395171880231 ◽  
Author(s):  
Justine Gangneux ◽  
Stevie Docherty

As researchers we often find ourselves grappling with social media platforms and data ‘at close quarters’. Although social media platforms were created for purposes other than academic research – which are apparent in their architecture and temporalities – they offer opportunities for researchers to repurpose them for the collection, generation and analysis of rich datasets. At the same time, this repurposing raises an evolving range of practical and methodological challenges at the small and large scale. We draw on our experiences and empirical data from two research projects, one using Facebook Community Pages and the other repurposing Facebook Activity Logs. This article reflects critically on the specific challenges we faced using these platform features, on their common roots, and the tactics we adopted in response. De Certeau’s distinction between strategy and tactics provides a useful framework for exploring these struggles as located in the practice of doing social research – which often ends up being tactical. This article argues that we have to collectively discuss, demystify and devise tactics to mitigate the strategies and temporalities deeply embedded in platforms, corresponding as far as possible to the temporalities and the aims of our research. Although combat at close quarters is inevitable in social media research, dialogue between researchers is more than ever needed to tip the scales in our favour.


2019 ◽  
Author(s):  
Curtis Lee Petersen ◽  
Ryan Halter ◽  
David Kotz ◽  
Lorie Loeb ◽  
Summer Cook ◽  
...  

BACKGROUND Sarcopenia, defined as the age-associated loss of muscle mass and strength, can be effectively mitigated through resistance-based physical activity. With compliance at approximately 40% for home-based exercise prescriptions, implementing a remote sensing system would help patients and clinicians to better understand treatment progress and increase compliance. The inclusion of end users in the development of mobile apps for remote-sensing systems can ensure that they are both user friendly and facilitate compliance. With advancements in natural language processing (NLP), there is potential for these methods to be used with data collected through the user-centered design process. OBJECTIVE This study aims to develop a mobile app for a novel device through a user-centered design process with both older adults and clinicians while exploring whether data collected through this process can be used in NLP and sentiment analysis METHODS Through a user-centered design process, we conducted semistructured interviews during the development of a geriatric-friendly Bluetooth-connected resistance exercise band app. We interviewed patients and clinicians at weeks 0, 5, and 10 of the app development. Each semistructured interview consisted of heuristic evaluations, cognitive walkthroughs, and observations. We used the Bing sentiment library for a sentiment analysis of interview transcripts and then applied NLP-based latent Dirichlet allocation (LDA) topic modeling to identify differences and similarities in patient and clinician participant interviews. Sentiment was defined as the sum of positive and negative words (each word with a +1 or −1 value). To assess utility, we used quantitative assessment questionnaires—System Usability Scale (SUS) and Usefulness, Satisfaction, and Ease of use (USE). Finally, we used multivariate linear models—adjusting for age, sex, subject group (clinician vs patient), and development—to explore the association between sentiment analysis and SUS and USE outcomes. RESULTS The mean age of the 22 participants was 68 (SD 14) years, and 17 (77%) were female. The overall mean SUS and USE scores were 66.4 (SD 13.6) and 41.3 (SD 15.2), respectively. Both patients and clinicians provided valuable insights into the needs of older adults when designing and building an app. The mean positive-negative sentiment per sentence was 0.19 (SD 0.21) and 0.47 (SD 0.21) for patient and clinician interviews, respectively. We found a positive association with positive sentiment in an interview and SUS score (ß=1.38; 95% CI 0.37 to 2.39; <i>P</i>=.01). There was no significant association between sentiment and the USE score. The LDA analysis found no overlap between patients and clinicians in the 8 identified topics. CONCLUSIONS Involving patients and clinicians allowed us to design and build an app that is user friendly for older adults while supporting compliance. This is the first analysis using NLP and usability questionnaires in the quantification of user-centered design of technology for older adults.


Geografie ◽  
2019 ◽  
Vol 124 (2) ◽  
pp. 133-161 ◽  
Author(s):  
Robert Roth

I ask in this essay: How do user-centered design studies contribute to cartography? Scholars in related fields increasingly recognize the intellectual value of employing user-centered processes to improve a single product and identify new design considerations for future products. To this end, I propose an analytical framework for organizing the contributions of user-centered design studies that includes eight opportunities for advancing cartography: (1) domain gap analyses, (2) adapted or novel user-centered methods, (3) streamlined user-centered design processes, (4) transferable design insights, (5) comprehensive user-centered design case studies, (6) novel or unique maps and visualizations, (7) summative controlled experiments, and (8) new insights into pressing geographic problems. I apply this framework against my own collaborative work in a retrospective analysis of three UCD case studies: the GeoVISTA CrimeViz visual analytics tool, the NOAA Lake Level Viewer climate change visualization, and the UW Cart Lab Global Madison mobile map.


2021 ◽  
Vol 236 ◽  
pp. 04050
Author(s):  
Cheng Hui

With the development of computer science, “user-centered” design assisted by intelligent technology is a new trend in China’s cultural and creative design. To clarify the research progress, the author reviewed the representative predecessor’s works in China, summarized a design process paradigm from their works, and classified the various design methods into a reasonable framework by manual content analysis. However, some problems still exist. The first is lack of intelligent design method promotion, and the other is the researchers are unaware that cultural and creative design has developed to a state with blurred boundary, in which the design not only means the design of cultural and creative products but also includes the design of exhibitions and education activities.


Sign in / Sign up

Export Citation Format

Share Document