Measuring patient satisfaction with video consultation: a systematic review of assessment tools and their measurement properties

BackgroundVideo consultation (VC) is considered promising in delivering healthcare closer to the patient and improving patient satisfaction. Indeed, providing care-at-distance via VC is believed to be promising for some situations and patients, serving their needs without associated concomitant costs. In order to assess implementation and perceived benefits, patient satisfaction is frequently measured. Measuring patient satisfaction with VC in healthcare is often performed using quantitative and qualitative outcome analysis. As studies employ different surveys, pooling of data on the topic is troublesome. This systematic review critically appraises, summarizes, and compares available questionnaires in order to identify the most suitable questionnaire for qualitative outcome research using VC in clinical outpatient care.MethodsPubMed, Embase, and Cochrane were searched for relevant articles using predefined inclusion criteria. Methodological quality appraisal of yielded questionnaires to assess VC was performed using the validated COSMIN guideline.ResultsThis systematic search identified twelve studies that used ten different patient satisfaction questionnaires. The overall quality of nine questionnaires was rated as “inadequate” to “doubtful” according to the COSMIN criteria. None of the questionnaires retrieved completed a robust validation process for the purpose of use.Conclusion and recommendationsAlthough high-quality studies on measurement properties of these questionnaires are scarce, the questionnaire developed by Mekhjian has the highest methodological quality achieving validity on internal consistency and the use of a large sample size. Moreover, this questionnaire can be used across healthcare settings. This finding may be instrumental in further studies measuring patient satisfaction with VC.

Download Full-text

A systematic review to assess the methodological quality of studies on measurement properties for caries risk assessment tools for young children

International Journal of Paediatric Dentistry ◽

10.1111/ipd.12446 ◽

2018 ◽

Vol 29 (2) ◽

pp. 106-116 ◽

Cited By ~ 2

Author(s):

Bradley Christian ◽

Rebecca Armstrong ◽

Hanny Calache ◽

Lauren Carpenter ◽

Lisa Gibbs ◽

...

Keyword(s):

Systematic Review ◽

Risk Assessment ◽

Young Children ◽

Methodological Quality ◽

Assessment Tools ◽

Measurement Properties ◽

Caries Risk ◽

Caries Risk Assessment ◽

Risk Assessment Tools

Download Full-text

Measuring Instruments In Cardiology Adapted Into Portuguese Language Of Brazil: A Systematic Review

Revista da Escola de Enfermagem da USP ◽

10.1590/s0080-6234201400002000023 ◽

2014 ◽

Vol 48 (2) ◽

pp. 368-376 ◽

Cited By ~ 2

Author(s):

Marilia Estevam Cornélio ◽

Neusa Maria Costa Alexandre ◽

Thaís Moreira São-João

Keyword(s):

Systematic Review ◽

Cultural Adaptation ◽

Methodological Quality ◽

Scientific Community ◽

Health Knowledge ◽

Critical Evaluation ◽

Measurement Properties ◽

Measuring Instruments ◽

Adaptation Process

This was a systematic review aimed at identifying and characterizing measuring instruments, developed in the context of cardiology, which were adapted into Portuguese language of Brazil. Systematic searches were performed in six databases. Information extracted included cultural adaptation process and measurement properties. To assess the methodological quality of studies, criteria based on international guidelines for cultural adaptation of instruments were used. Among the 114 articles found, 14 were eligible for review. Of these, most evaluated quality of life (35.7%) and health knowledge/learning (28.6%). Most studies followed all stages of the adaptation process recommended in the literature. With respect to measurement properties, internal consistency, verified by Cronbach’s alpha, was the property reported in the majority of the studies, as well as construct and criterion validity. This study is expected to provide to the scientific community a critical evaluation of adapted questionnaires available in the context of cardiology. 

Download Full-text

How Well can Your Smartphone Measure What you eat, Drink and Smoke? A Systematic Review of the Measurement Properties of Smartphone Approaches to Assess Diet, Alcohol use and Tobacco use. (Preprint)

10.2196/preprints.27337 ◽

2021 ◽

Author(s):

Louise Thornton

Keyword(s):

Systematic Review ◽

Chronic Disease ◽

Alcohol Use ◽

Tobacco Use ◽

Methodological Quality ◽

Measurement Techniques ◽

Health Behaviours ◽

Measurement Properties ◽

Measurement Approach

BACKGROUND Poor diet, alcohol use and tobacco smoking have been identified as strong determinants of chronic disease, such as cardiovascular disease, diabetes and cancers. Smartphones have the potential to provide a real-time, pervasive, unobtrusive and cost-effective way to measure these health behaviours and deliver instant feedback to users. Despite this, the validity of using smartphones to measure these behaviours is largely unknown. OBJECTIVE The aim of our review was to identify existing smartphone—based approaches to measure these health behaviours and critically appraise the quality of their measurement properties. METHODS We conducted a systematic search of the Ovid MEDLINE, Embase (Elsevier), Cochrane Library (Wiley), PsychINFO (EBSCOhost), CINAHL (EBSCOHost), Web of Science (Clarivate), SPORTDiscus (EBSCOhost), and IEEE Xplore Digital Library databases in March 2020. Studies that were written in English, reported measuring diet, alcohol use and/or tobacco use via a smartphone, and reported on at least one measurement property (eg validity, reliability and/or responsiveness) were eligible. Outcomes were summarised in a narrative synthesis. This systematic review is registered with PROSPERO, identifier CRD42019122242. RESULTS Of 12,261 records, 72 studies describing the measurement properties of smartphone—based approaches to measure diet (n=48), alcohol use (n=16) and tobacco use (n=8) were identified and included in the current review. Across the health behaviours, 18 different measurement techniques were used within smartphones. The measurement properties most commonly examined were construct validity, measurement error and criterion validity. Results varied by behaviour and measurement approach and the methodological quality of studies varied widely. Most studies investigating the measurement of diet and alcohol received ‘very good’ or ‘adequate’ methodological quality ratings (72.9%, 35/48, and 68.8%, 11/16, respectively), while only one study (12.5%, 1/8) investigating the measurement of tobacco use received a ‘very good’ or ‘adequate’ rating. CONCLUSIONS This review is the first to bring together evidence regarding the different types of smartphone—based approaches currently used to measure key behavioural risk factors for chronic disease (diet, alcohol use and tobacco use) and the quality of their measurement properties. Nineteen measurement techniques were identified, the majority of which assessed dietary behaviours (67%, n=48/72). Some evidence exists to support the reliability and validity of using smartphones to assess these behaviours, however results varied by behaviour and measurement approach. The methodological quality of included studies also varied. Overall, more high-quality studies validating smartphone based approaches against criterion measures are needed. More research investigating the use of smartphones to assess alcohol and tobacco use, and objective measurement approaches is also needed. INTERNATIONAL REGISTERED REPORT RR2-https://doi.org/10.1186/s13643-020-01375-w

Download Full-text

Somatic Acupoint Stimulation for Cancer-Related Sleep Disturbance: A Systematic Review of Randomized Controlled Trials

Evidence-based Complementary and Alternative Medicine ◽

10.1155/2020/2591320 ◽

2020 ◽

Vol 2020 ◽

pp. 1-12

Author(s):

Xian-Liang Liu ◽

Hui Lin Cheng ◽

Simon Moss ◽

Carol Chunfeng Wang ◽

Catherine Turner ◽

...

Keyword(s):

Systematic Review ◽

Sleep Disturbance ◽

Sample Size ◽

Methodological Quality ◽

Outcome Measurement ◽

Small Sample ◽

Large Sample Size ◽

Intervention Protocol ◽

Acupoint Stimulation

Aim. The aim of this systematic review was to analyze and synthesize available evidence for the effects of somatic acupoint stimulation (SAS) on cancer-related sleep disturbance in adults with cancer. Methods. Nine databases and four clinical trial registries were searched from their inception to July 2019 to identify potential articles and registered trials. Two authors independently extracted data and appraised the methodological quality of the included studies. The included studies could not be subjected to meta-analysis due to the significant variations in SAS intervention protocols and outcome measurement instruments. This systematic review therefore reported the results of the included trials narratively. Results. Seven studies were identified, which involved 906 cancer patients. SAS protocols varied across trials without an optimal evidence-based standard intervention protocol to manage cancer-related sleep disturbance. Sanyinjiao (SP6) was the most commonly selected acupoint. Manual acupuncture was typically 15–30 min in duration and was conducted once a day or once a week for a period of 1–5 weeks, whereas self-administered acupressure was typically 1–3 min in duration per point and was conducted once a day, such as during night time before going to bed, for a period of 1–5 months. The results indicated that SAS could potentially relieve cancer-related sleep disturbance and improve quality of life. Mild adverse effects were reported in three of the included studies, but none of them performed a causality analysis to clarify the association between the reported adverse events and the intervention. Conclusions. This systematic review showed that SAS is a useful approach to relieving cancer-related sleep disturbance. However, research evidence on SAS for managing cancer-related sleep disturbance has not been fully conclusive due to the limited number of existing clinical studies with relatively small sample size and suboptimal methodological quality. Clinical trials with large sample size and robust methodology are warranted in future research.

Download Full-text

Psychometric properties of the Jefferson Scale of Empathy: a COSMIN systematic review protocol

Systematic Reviews ◽

10.1186/s13643-019-1240-0 ◽

2019 ◽

Vol 8 (1) ◽

Cited By ~ 1

Author(s):

Brett Williams ◽

Bronwyn Beovich

Keyword(s):

Systematic Review ◽

Psychometric Properties ◽

Methodological Quality ◽

Grey Literature ◽

Risk Of Bias ◽

Measurement Properties ◽

Future Research ◽

Health Measurement ◽

Jefferson Scale Of Empathy

Abstract Background Empathy is an important characteristic to possess for healthcare professionals. It has been found to improve communication between professionals and patients and to improve clinical health outcomes. The Jefferson Scale of Empathy (JSE) was developed to measure this quality and has been used extensively, and psychometrically appraised, with a variety of cohorts and in different cultural environments. However, no study has been undertaken to systematically examine the methodological quality of studies which have assessed psychometric factors of the JSE. This systematic review will examine the quality of published papers that have reported on psychometric factors of the JSE. Methods A systematic review of studies which report on the psychometric properties of the JSE will be conducted. We will use a predefined search strategy to identify studies meeting the following eligibility criteria: original data is reported on for at least one of the psychometric measurement properties described in the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist, examines the JSE in a healthcare cohort (using the student, physician or health profession versions of the JSE), and is published from January 2001 and in the English language. Conference abstracts, editorials and grey literature will be excluded. Six electronic databases (Medline, EMBASE, PsychInfo, PubMed, Web of Science and CINAHL) will be systematically searched for articles meeting these criteria and studies will be assessed for eligibility by two review authors. The methodological quality of included papers will be examined using the COSMIN Risk of Bias checklist. Discussion A narrative description of the findings will be presented along with summary tables. Recommendations for use of the JSE with various cohorts and circumstances will be offered which may inform future research in this field. Systematic review registration PROSPERO CRD42018111412

Download Full-text

Systematic review of the psychometric properties of patient-reported outcome measures for rheumatoid arthritis in the foot and ankle

Clinical Rehabilitation ◽

10.1177/0269215519862328 ◽

2019 ◽

Vol 33 (11) ◽

pp. 1788-1799 ◽

Cited By ~ 2

Author(s):

Ana Belen Ortega-Avila ◽

Laura Ramos-Petersen ◽

Pablo Cervera-Garvi ◽

Christopher J Nester ◽

José Miguel Morales-Asencio ◽

...

Keyword(s):

Rheumatoid Arthritis ◽

Systematic Review ◽

Psychometric Properties ◽

Outcome Measures ◽

Methodological Quality ◽

Measurement Properties ◽

Foot And Ankle ◽

Inclusion Criteria ◽

Patient Reported

Objective: To identify self-reported outcome measures specific to the foot and ankle in patients with rheumatoid arthritis and to investigate the methodological quality and psychometric properties of these measures. Method: A systematic review focusing on patients with rheumatoid arthritis. Setting: The search was conducted in the PubMed, SCOPUS, CINAHL, PEDro and Google Scholar databases, based on the following inclusion criteria: population (with rheumatoid arthritis) > 18 years; psychometric or clinimetric validation studies of patient-reported outcomes specific to the foot and ankle, in different languages, with no time limit. Two of the present authors independently assessed the quality of the studies located and extracted the relevant data. Terwee’s criteria and the COSMIN checklist were employed to ensure adequate methodological quality. Results: Of the initial 431 studies considered, 14 met the inclusion criteria, representing 7,793 patients (56.8 years). These instruments were grouped into three dimensions (pain, perceived health status and quality of life and disability). The time to complete any of the PROMs varies around 15 minutes. PROMs criterias with the worst scores by COSMIN, 92.85% and 85.71% were criterion validity, measurement error, internal consistency and responsiveness. 28.57% of PROMs were compared with the measurement properties. Conclusion: the Self-Reported Foot and Ankle Score achieved the highest number of positive criteria (according to Terwee and COSMIN), and is currently the most appropriate for patients with Rheumatoid arthritis.

Download Full-text

Instruments for Measuring Satisfaction With Physical Therapy Care: A Systematic Review

Physical Therapy ◽

10.1093/ptj/pzaa111 ◽

2020 ◽

Vol 100 (9) ◽

pp. 1690-1700

Author(s):

Daniel Gutiérrez-Sánchez ◽

David Pérez-Cruzado ◽

Antonio I Cuesta-Vargas

Keyword(s):

Systematic Review ◽

Patient Satisfaction ◽

Physical Therapy ◽

Psychometric Properties ◽

Methodological Quality ◽

Cochrane Library ◽

Measurement Instruments ◽

Health Measurement ◽

Selection Of

Abstract Objective Several instruments to measure patient satisfaction have been developed to assess satisfaction with physical therapy care. The selection of the most appropriate instrument is very important. The purpose of this study was to identify instruments for assessing satisfaction with physical therapy care and their psychometric properties and to evaluate the methodological quality of studies on psychometric properties. Methods A systematic search was conducted in ProQuest Medline, SciELO, ProQuest PsycINFO, Theseus, Cochrane Library, and Google Scholar. Articles published from 1990 to 2019, in English and Spanish, were used as limits. This systematic review followed the Consensus-based Standards for the Selection of Health Measurement Instruments and Preferred Reporting Items for Systematic Reviews and Meta-Analyses standards. The articles were evaluated by 2 independent reviewers using the Consensus-based Standards for the Selection of Health Measurement Instruments 4-point checklist. Eighteen studies were included. Results Nine instruments were found to be specifically designed to assess satisfaction with physical therapy care. The methodological quality of the studies was “fair” for most of the psychometric characteristics analyzed (43 items), with 24 properties scored as “poor,” 5 as “good,” and 3 as “excellent.” Conclusions Different instrument characteristics—such as the scope and population with which the instrument will be used, its dimensions, the number of items, and the evidence shown in the evaluation of each psychometric property—should be considered by clinicians and researchers to decide which instrument is the best to measure the construct of patient satisfaction with physical therapy. Impact Evaluating patient satisfaction is very useful in clinical practice at the hospital, community, and primary care levels. Physical therapist clinicians and researchers can use this systematic review to select instruments whose characteristics will best measure their patients’ satisfaction with physical therapy care.

Download Full-text

The Six-Minute Walk Test in Chronic Pediatric Conditions: A Systematic Review of Measurement Properties

Physical Therapy ◽

10.2522/ptj.20120210 ◽

2013 ◽

Vol 93 (4) ◽

pp. 529-541 ◽

Cited By ~ 82

Author(s):

Bart Bartels ◽

Janke F. de Groot ◽

Caroline B. Terwee

Keyword(s):

Systematic Review ◽

Strong Evidence ◽

Methodological Quality ◽

Measurement Properties ◽

Walk Test ◽

Test Procedures ◽

Six Minute Walk Test ◽

Patient Groups ◽

Minute Walk

Background The Six-Minute Walk Test (6MWT) is increasingly being used as a functional outcome measure for chronic pediatric conditions. Knowledge about its measurement properties is needed to determine whether it is an appropriate test to use. Purpose The purpose of this study was to systematically review all published clinimetric studies on the 6MWT in chronic pediatric conditions. Data Sources The databases MEDLINE, EMBASE, CINAHL, PEDro, and SPORTDiscus were searched up to February 2012. Study Selection Studies designed to evaluate measurement properties of the 6MWT in a chronic pediatric condition were included in the systematic review. Data Extraction The methodological quality of the included studies and the measurement properties of the 6MWT were examined. Data Synthesis A best evidence synthesis was performed on 15 studies, including 9 different chronic pediatric conditions. Limited evidence to strong evidence was found for reliability in various chronic conditions. Strong evidence was found for positive criterion validity of the 6MWT with peak oxygen uptake in some populations, but negative criterion validity was found in other populations. Construct validity remained unclear in most patient groups because of methodological flaws. Little evidence was available for responsiveness and measurement error. Studies showed large variability in test procedures despite existing guidelines for the performance of the 6MWT. Limitations Unavailability of a specific checklist to evaluate the methodological quality of clinimetric studies on performance measures was a limitation of the study. Conclusions Evidence for measurement properties of the 6MWT varies largely among chronic pediatric conditions. Further research is needed in all patient groups to explore the ability of the 6MWT to measure significant and clinically important changes. Until then, changes measured with the 6MWT should be interpreted with caution. Future studies or consensus regarding modified test procedures in the pediatric population is recommended.

Download Full-text

Measuring test-retest reliability (TRR) of AMSTAR provides moderate to perfect agreement – a contribution to the discussion of the importance of TRR in relation to the psychometric properties of assessment tools

BMC Medical Research Methodology ◽

10.1186/s12874-021-01231-y ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Stefanie Bühn ◽

Peggy Ober ◽

Tim Mathes ◽

Uta Wegewitz ◽

Anja Jacobs ◽

...

Keyword(s):

Psychometric Properties ◽

Systematic Reviews ◽

Methodological Quality ◽

Assessment Tools ◽

Measurement Properties ◽

Perfect Agreement ◽

Retest Reliability ◽

Test Retest Reliability ◽

The Impact

Abstract Background Systematic Reviews (SRs) can build the groundwork for evidence-based health care decision-making. A sound methodological quality of SRs is crucial. AMSTAR (A Measurement Tool to Assess Systematic Reviews) is a widely used tool developed to assess the methodological quality of SRs of randomized controlled trials (RCTs). Research shows that AMSTAR seems to be valid and reliable in terms of interrater reliability (IRR), but the test retest reliability (TRR) of AMSTAR has never been investigated. In our study we investigated the TRR of AMSTAR to evaluate the importance of its measurement and contribute to the discussion of the measurement properties of AMSTAR and other quality assessment tools. Methods Seven raters at three institutions independently assessed the methodological quality of SRs in the field of occupational health with AMSTAR. Between the first and second ratings was a timespan of approximately two years. Answers were dichotomized, and we calculated the TRR of all raters and AMSTAR items using Gwet’s AC1 coefficient. To investigate the impact of variation in the ratings over time, we obtained summary scores for each review. Results AMSTAR item 4 (Was the status of publication used as an inclusion criterion?) provided the lowest median TRR of 0.53 (moderate agreement). Perfect agreement of all reviewers was detected for AMSTAR-item 1 with a Gwet’s AC1 of 1, which represented perfect agreement. The median TRR of the single raters varied between 0.69 (substantial agreement) and 0.89 (almost perfect agreement). Variation of two or more points in yes-scored AMSTAR items was observed in 65% (73/112) of all assessments. Conclusions The high variation between the first and second AMSTAR ratings suggests that consideration of the TRR is important when evaluating the psychometric properties of AMSTAR.. However, more evidence is needed to investigate this neglected issue of measurement properties. Our results may initiate discussion of the importance of considering the TRR of assessment tools. A further examination of the TRR of AMSTAR, as well as other recently established rating tools such as AMSTAR 2 and ROBIS (Risk Of Bias In Systematic reviews), would be useful.

Download Full-text