scholarly journals Evaluating the complexity of online patient education materials about brain aneurysms published by major academic institutions

2017 ◽  
Vol 127 (2) ◽  
pp. 278-283 ◽  
Author(s):  
Raghav Gupta ◽  
Nimer Adeeb ◽  
Christoph J. Griessenauer ◽  
Justin M. Moore ◽  
Apar S. Patel ◽  
...  
Keyword(s):  
Patient Education ◽  
Education Level ◽  
Reading Level ◽  
College Level ◽  
Academic Institutions ◽  
Patient Anxiety ◽  
Flesch Reading Ease ◽  
Brain Aneurysms ◽  
Grade Reading Level ◽  
Online Patient Education

OBJECTIVEHealth care education resources are increasingly available on the Internet. A majority of people reference these resources at one point or another. A threshold literacy level is needed to comprehend the information presented within these materials. A key component of health literacy is the readability of educational resources. The National Institutes of Health (NIH) and the American Medical Association have recommended that patient education materials be written between a 4th- and a 6th-grade education level. The authors assessed the readability of online patient education materials about brain aneurysms that have been published by several academic institutions across the US.METHODSOnline patient education materials about brain aneurysms were downloaded from the websites of 20 academic institutions. The materials were assessed via 8 readability scales using Readability Studio software (Oleander Software Solutions), and then were statistically analyzed.RESULTSNone of the patient education materials were written at or below the NIH's recommended 6th-grade reading level. The average educational level required to comprehend the texts across all institutions, as assessed by 7 of the readability scales, was 12.4 ± 2.5 (mean ± SD). The Flesch Reading Ease Scale classified the materials as “difficult” to understand, correlating with a college-level education or higher. An ANOVA test found that there were no significant differences in readability among the materials from the institutions (p = 0.215).CONCLUSIONSBrain aneurysms affect 3.2% of adults 50 years or older across the world and can cause significant patient anxiety and uncertainty. Current patient education materials are not written at or below the NIH's recommended 4th- to 6th-grade education level.

Readability Assessment of Patient Education Materials on Major Otolaryngology Association Websites

2012 ◽  
Vol 147 (5) ◽  
pp. 848-854 ◽  
Author(s):  
Jean Anderson Eloy ◽  
Shawn Li ◽  
Khushabu Kasabwala ◽  
Nitin Agarwal ◽  
David R. Hansberry ◽  
...  
Keyword(s):  
Patient Education ◽  
Sixth Grade ◽  
Reading Level ◽  
Flesch Reading Ease ◽  
Education Material ◽  
Individual Assessment ◽  
Honestly Significant Difference ◽  
Significant Difference ◽  
Grade Reading Level ◽  
Post Hoc

Objective Various otolaryngology associations provide Internet-based patient education material (IPEM) to the general public. However, this information may be written above the fourth- to sixth-grade reading level recommended by the American Medical Association (AMA) and National Institutes of Health (NIH). The purpose of this study was to assess the readability of otolaryngology-related IPEMs on various otolaryngology association websites and to determine whether they are above the recommended reading level for patient education materials. Study Design and Setting Analysis of patient education materials from 9 major otolaryngology association websites. Methods The readability of 262 otolaryngology-related IPEMs was assessed with 8 numerical and 2 graphical readability tools. Averages were evaluated against national recommendations and between each source using analysis of variance (ANOVA) with post hoc Tukey’s honestly significant difference (HSD) analysis. Mean readability scores for each otolaryngology association website were compared. Results Mean website readability scores using Flesch Reading Ease test, Flesch-Kincaid Grade Level, Coleman-Liau Index, SMOG grading, Gunning Fog Index, New Dale-Chall Readability Formula, FORCAST Formula, New Fog Count Test, Raygor Readability Estimate, and the Fry Readability Graph ranged from 20.0 to 57.8, 9.7 to 17.1, 10.7 to 15.9, 11.6 to 18.2, 10.9 to 15.0, 8.6 to 16.0, 10.4 to 12.1, 8.5 to 11.8, 10.5 to 17.0, and 10.0 to 17.0, respectively. ANOVA results indicate a significant difference ( P < .05) between the websites for each individual assessment. Conclusion The IPEMs found on all otolaryngology association websites exceed the recommended fourth- to sixth-grade reading level.

scholarly journals Achilles Tendon Repair: Can Patients Read, Understand, and Act on Online Educational Resources?

2020 ◽  
Vol 5 (4) ◽  
pp. 2473011420S0022
Author(s):  
Burke Gao ◽  
Alan G. Shamrock ◽  
Trevor Gulbrandsen ◽  
John E. Femino ◽  
Cesar de Cesar Netto ◽  
...  
Keyword(s):  
Patient Education ◽  
Achilles Tendon ◽  
Grade Level ◽  
Elective Surgery ◽  
Tendon Repair ◽  
Reading Level ◽  
Achilles Tendon Repair ◽  
Grade Reading Level ◽  
Google Search ◽  
Online Patient Education

Category: Sports; Trauma Introduction/Purpose: Patients often access online resources to learn about orthopedic procedures prior to undergoing elective surgery. In order to be fully understood by the average English-speaking adult, online health information must be written at an elementary school reading level. To be helpful to patients, educational resources should also be generally understandable and have actionable direction that positively affects healthcare interactions. There are several previously validated indices for accessing the reading level of written materials. The Patient Education Materials Assessment Tool (PEMAT) provides a reliable and validated method to measure the understandability and actionability of education materials. The purpose of this study was to utilize PEMAT and readability algorithms to quantify readability, understandability and actionability of online patient education materials related to Achilles tendon repair. Methods: Online patient education materials were identified using two independently conducted Google engine searches with the term ‘Achilles tendon repair’. Using the top 50 search results, articles were included if they specifically served to educate patients regarding TAA. Exclusion criteria included news articles, non-text materials (video), research manuscripts, industry websites, and articles not related to Achilles tendon repair. The readability of included articles was quantified using the validated Flesch-Kincaid Grade Level index. The PEMAT form for printed materials was used to assess understandability and actionability using a 0-100 scale for both measures of interest. Spearman’s correlation coefficient was utilized to examine the relationship between a website’s average rank on Google (from first to last) and its readability, understandability, and actionability. P-values of less than 0.05 were considered significant. Results: Thirty-one websites met inclusion criteria. The mean Flesch Kincaid reading grade level was 10.8+-2.9, with only one website written below the 6th grade reading level. Higher Flesch-Kincaid grade was associated with later Google seach rank (rho: 0.488, p=0.010). Mean understandability and actionability scores were 67.1+-16.4% and 38.3+-28.4%, respectively. Among understandability criteria, only 12.9% (n=4) of articles included summaries and just 38.7% (n=12) included visual aids. Among actionability categories, 74% (n=23) of websites identified at least one action for readers, while only 60.8% (n=14) of these studies broke down actions into explicit, easy to understand steps. Actionability scores were not correlated with Google search rank (rho: -0.02, p=0.888), while higher understandability scores were associated with later Google search rank (rho: 0.45, p=0.017). Conclusion: Only one website describing Achilles tendon repair was written at or below the nationally recommended 6th grade reading level. Overall, Achilles tendon repair online educational materials scored poorly with respect to readability, understandability, and actionability. Articles that appeared earlier in the Google search had lower readability and understandability scores. In the era of shared decision making, it is vital that patients understand procedures, as well as the risks and benefits prior to undergoing elective surgery. These results suggest that current publicly available resources for Achilles tendon repair remain inadequate for patient education.

Assessment of the Readability of Online Patient Education Material from Major Canadian Pediatric Associations (Preprint)

2021 ◽  
Author(s):  
Alice Man ◽  
Courtney van Ballegooie
Keyword(s):  
Patient Education ◽  
Medical Information ◽  
Health Behaviours ◽  
Reading Level ◽  
Pediatric Society ◽  
Word Analysis ◽  
Education Material ◽  
Preventative Health ◽  
Grade Reading Level ◽  
Online Patient Education

BACKGROUND Online patient education materials (PEMs) are frequently written above the recommended reading level in North America. Poor PEM readability limits the accessibility of medical information to individuals with average to lower literacy levels. Pediatric hospital and association websites have not only been shown to be a preferred source of information among caregivers but have also become a necessity in the COVID-19 pandemic. The readability of Canadian pediatric association websites has not yet been assessed quantitatively. OBJECTIVE To assess the readability of online Canadian pediatric association PEMs to determine if the content of the material is written at a reading level that the majority of Canadians can understand. METHODS PEMs were extracted from ten Canadian pediatric associations and evaluated for their reading level using ten validated readability scales. Associations underwent a difficult word analysis and cross association comparisons were assessed. RESULTS Online PEMs were identified from three pediatric association websites, where the grade reading level was found to be 8.8 +/- 1.8 for the Caring for Kids website, 9.5 +/- 2.2 for the Pediatric Endocrine Group website and 13.1 +/- 2.1 for the Atlantic Pediatric Society website. The difficulty word analysis identified that 19.9% of words were unfamiliar overall. CONCLUSIONS The online PEMs were found to be written above the recommended seventh grade reading level for Canadians. Consideration should be made to create PEMs at an appropriate grade reading level for both patients and their caregivers to encourage health literacy and ultimately promote preventative health behaviours and child health outcomes.

Quality of Patient Education Sections on Otitis Media Across Different Website Platforms

2020 ◽  
Vol 129 (6) ◽  
pp. 591-598 ◽  
Author(s):  
Kunal Ramanand Shetty ◽  
Rita Yu Wang ◽  
Anisha Shetty ◽  
Jessica Levi ◽  
Nicole Leigh Aaronson
Keyword(s):  
Patient Education ◽  
American Academy ◽  
Otitis Media ◽  
Neck Surgery ◽  
Educational Background ◽  
Reading Level ◽  
Flesch Reading Ease ◽  
8Th Grade ◽  
Ease Score ◽  
Grade Reading Level

Objective: To determine the quality, content, and readability of patient education materials pertaining to otitis media across several popular online platforms focused on otolaryngology and pediatric primary care education. Methods: Online patient materials related to otitis media and directed toward parents were collected from the American Association for Family Practice (AAFP), ENT-Health section of the American Academy of Otolaryngology—Head and Neck Surgery, Healthychildren.org from the American Academy of Pediatrics, KidsHealth from Nemours, WebMD, and Wikipedia. Materials were analyzed for quality, content, and readability. The DISCERN instrument was used to score quality. A unique content score was generated based on the information provided on each website and on the medical and surgical management of otitis media. Readability scores were calculated using the Flesch-Kincaid Grade Level, Flesch Reading Ease Score, Gunning-Fog Index, Simple Measure of Gobbledygook, Coleman-Liau Index, and Automated Readability Index. Results: Overall, content was well-balanced. Information from AAFP and Healthychildren.org was focused more on medical management than other sources. The average DISCERN scores showed all sources to be of good quality with minimal shortcomings. The AAFP and KidsHealth websites had some readability scores around the 8th-grade reading level, the National Institute of Health’s upper limit recommended for public health information; however, most websites were above this recommended reading level. Conclusion: Patient education materials related to otitis media on academic and certain popular internet sites are good sources to obtain high-quality information on the topic. Patient educational background, prior knowledge and understanding of otitis media, and physician-patient partnership goals should be taken into account when referring patients to online materials.

scholarly journals Readability and quality assessment of internet-based patient education materials related to nasal septoplasty

2021 ◽  
Vol 50 (1) ◽  
Author(s):  
Elysia M. Grose ◽  
Connor P. Holmes ◽  
Kaishan A. Aravinthan ◽  
Vincent Wu ◽  
John M. Lee
Keyword(s):  
Patient Education ◽  
Grade Level ◽  
Reading Level ◽  
Common Procedure ◽  
Flesch Reading Ease ◽  
Quality And Reliability ◽  
Google Search ◽  
The Impact ◽  
Online Patient Education ◽  
Nasal Septoplasty

Abstract Background Given that nasal septoplasty is a common procedure in otolaryngology – head and neck surgery, the objective of this study was to evaluate the quality and readability of online patient education materials on septoplasty. Methods A Google search was performed using eight different search terms related to septoplasty. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability. Results Eighty-five online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 54.9 ± 11.5, indicating they were fairly difficult to read. The average reading grade level was 10.5 ± 2.0, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 42.9 ± 10.5 and 42% (36/85) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality. Conclusion The majority of online patient education materials on septoplasty are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ decision making.

Hearing Aid Patient Education Materials: Is There Room for Improvement?

2016 ◽  
Vol 27 (04) ◽  
pp. 354-359 ◽  
Author(s):  
John Joseph ◽  
Peter F. Svider ◽  
Kevin Shaigany ◽  
Jean Anderson Eloy ◽  
Paulette G. McDonald ◽  
...  
Keyword(s):  
Patient Education ◽  
Hearing Aids ◽  
Web Sites ◽  
Grade Level ◽  
Hearing Aid ◽  
Reading Level ◽  
Reading Levels ◽  
Flesch Reading Ease ◽  
Average Grade ◽  
Grade Reading Level

Purpose: The purpose of this study was to analyze and compare the readability of patient education materials (PEMs) from leading manufacturers of behind-the-ear style hearing aids and popular hearing aid information Web sites to determine if they meet guidelines recommended by public health agencies. Research Design: Analysis of hearing aid PEMs. Methods: Printed user guides from six of the leading manufacturers of BTE hearing aids and 15 of the most popular hearing aid–information Web sites were accessed online and analyzed for readability using the Gunning-Fog Index, New Fog Count, Raygor Estimate Graph, Simple Measure of Gobbledygook, and Flesch Reading Ease score. Results: Overall average grade–level readability for all six printed manufacturer user manuals was calculated to be written at a 10th grade reading level. Overall average grade-level readabilities for all 15 popular online hearing aid–information Web sites representing professional organizations, suppliers, and health information services were calculated to be written at 10th, 10th, and 11th grade reading levels, respectively. Average Flesch Reading Ease scores for all printed guides and online patient information Web sites were calculated to fall within the fairly difficult category for readability. Conclusions: PEMs provided by top hearing aid manufactures and popular hearing aid Web sites are written well above the reading level recommended by the National Institutes of Health. Consideration should be given toward simplifying these materials in order to enhance user experience and increase compliance among behind-the-ear hearing aid users.

scholarly journals Bladder Cancer Health Literacy: Assessing Readability of Online Patient Education Materials

2020 ◽  
pp. 1-8
Author(s):  
Lauren E. Powell ◽  
Theodore I. Cisu ◽  
Adam P. Klausner
Keyword(s):  
Bladder Cancer ◽  
Health Literacy ◽  
Patient Education ◽  
Search Engine ◽  
Reading Ability ◽  
Health Care Expenditure ◽  
Reading Level ◽  
T Test ◽  
Grade Levels ◽  
Grade Reading Level

BACKGROUND: Understanding of health-related materials, termed health literacy, affects decision makings and outcomes in the treatment of bladder cancer. The National Institutes of Health recommend writing education materials at a sixth-seventh grade reading level [6]. The goal of this study is to assess readability of bladder cancer materials available online. OBJECTIVE: The goal of this study is to characterize available information about bladder cancer online and evaluate readability. METHODS: Materials on bladder cancer were collected from the American Urological Association’s Urology Care Foundation (AUA-UCF) and compared to top 50 websites by search engine results. Resources were analyzed using four different validated readability assessment scales. The mean and standard deviation of the materials was calculated, and a two-tailed t test for used to assess for significance between the two sets of patient education materials. RESULTS: The average readability of AUA materials was 8.5 (8th–9th grade reading level). For the top 50 websites, average readability was 11.7 (11–12th grade reading level). A two-tailed t test between the AUA and top 50 websites demonstrated statistical significance between the readability of the two sets of resources (P = 0.0001), with the top search engine results being several grade levels higher than the recommended 6–7th grade reading level. CONCLUSIONS: Most health information provided by the AUA on bladder cancer is written at a reading ability that aligns with most US adults, with top websites for search engine results exceeding the average reading level by several grade levels. By focusing on health literacy, urologists may contribute lowering barriers to health literacy, improving health care expenditure and perioperative complications.

scholarly journals Readability Assessment of Online Patient Education Material on Congestive Heart Failure

2017 ◽  
Vol 2017 ◽  
pp. 1-8 ◽  
Author(s):  
Akhil Kher ◽  
Sandra Johnson ◽  
Robert Griffith
Keyword(s):  
Heart Failure ◽  
Congestive Heart Failure ◽  
Patient Education ◽  
General Population ◽  
Sixth Grade ◽  
Assessment Tools ◽  
Flesch Reading Ease ◽  
Readability Assessment ◽  
Readability Level ◽  
Online Patient Education

Background. Online health information is being used more ubiquitously by the general population. However, this information typically favors only a small percentage of readers, which can result in suboptimal medical outcomes for patients. Objective. The readability of online patient education materials regarding the topic of congestive heart failure was assessed through six readability assessment tools. Methods. The search phrase “congestive heart failure” was employed into the search engine Google. Out of the first 100 websites, only 70 were included attending to compliance with selection and exclusion criteria. These were then assessed through six readability assessment tools. Results. Only 5 out of 70 websites were within the limits of the recommended sixth-grade readability level. The mean readability scores were as follows: the Flesch-Kincaid Grade Level (9.79), Gunning-Fog Score (11.95), Coleman-Liau Index (15.17), Simple Measure of Gobbledygook (SMOG) index (11.39), and the Flesch Reading Ease (48.87). Conclusion. Most of the analyzed websites were found to be above the sixth-grade readability level recommendations. Efforts need to be made to better tailor online patient education materials to the general population.

scholarly journals Quality Assessment of Online Patient Information for Cosmetic Botulinum Toxin

2020 ◽  
Vol 40 (11) ◽  
pp. NP636-NP642 ◽  
Author(s):  
Eric Barbarite ◽  
David Shaye ◽  
Samuel Oyer ◽  
Linda N Lee
Keyword(s):  
Botulinum Toxin ◽  
Patient Education ◽  
Online Education ◽  
Grade Level ◽  
Assessment Tool ◽  
Botulinum Toxin Injection ◽  
Reading Level ◽  
Accuracy Score ◽  
Flesch Reading Ease

Abstract Background In an era of widespread Internet access, patients increasingly look online for health information. Given the frequency with which cosmetic botulinum toxin injection is performed, there is a need to provide patients with high-quality information about this procedure. Objectives The aim of this study was to examine the quality of printed online education materials (POEMs) about cosmetic botulinum toxin. Methods An Internet search was performed to identify 32 websites of various authorship types. Materials were evaluated for accuracy and inclusion of key content points. Readability was measured by Flesch Reading Ease and Flesch-Kincaid Grade Level. Understandability and actionability were assessed with the Patient Education Materials Assessment Tool for Printed Materials. The effect of authorship was measured by undertaking analysis of variance between groups. Results The mean [standard deviation] accuracy score among all POEMs was 4.2 [0.7], which represents an accuracy of 76% to 99%. Mean comprehensiveness was 47.0% [16.4%]. Mean Flesch-Kincaid Grade Level and Flesch Reading Ease scores were 10.7 [2.1] and 47.9 [10.0], respectively. Mean understandability and actionability were 62.8% [18.8%] and 36.2% [26.5%], respectively. There were no significant differences between accuracy (P &gt; 0.2), comprehensiveness (P &gt; 0.5), readability (P &gt; 0.1), understandability (P &gt; 0.3), or actionability (P &gt; 0.2) by authorship. Conclusions There is wide variability in the quality of cosmetic botulinum toxin POEMs regardless of authorship type. The majority of materials are written above the recommended reading level and fail to include important content points. It is critical that providers take an active role in the evaluation and endorsement of online patient education materials.

scholarly journals Total Ankle Arthroplasty: Can Patients Read, Understand, and Act on Online Educational Resources?

2020 ◽  
Vol 5 (4) ◽  
pp. 2473011420S0008
Author(s):  
Alan G. Shamrock ◽  
Burke Gao ◽  
Trevor Gulbrandsen ◽  
John E. Femino ◽  
Cesar de Cesar Netto ◽  
...  
Keyword(s):  
Elementary School ◽  
Patient Education ◽  
Grade Level ◽  
Elective Surgery ◽  
Reading Level ◽  
Total Ankle Arthroplasty ◽  
Educational Resources ◽  
Ankle Arthroplasty ◽  
Google Search ◽  
Online Patient Education

Category: Ankle Arthritis; Ankle Introduction/Purpose: Patients often access online resources to learn about orthopedic procedures prior to undergoing elective surgery. In order to be fully understood by the average English-speaking adult, online health information must be written at an elementary school reading level. To be helpful to patients, educational resources should also be generally understandable and have actionable direction that positively affects their healthcare interactions. There are several previously validated indices for accessing the reading level of written materials. The Patient Education Materials Assessment Tool (PEMAT) provides a reliable and validated method to measure the understandability and actionability of education materials. The purpose of this study was to utilize PEMAT and readability algorithms to quantify readability, understandability and actionability of online patient education materials related to total ankle arthroplasty (TAA). Methods: Online patient education materials were identified using two independently conducted Google engine searches with the term ‘ankle replacement’. Using the top 50 search results, articles were included if they specifically served to educate patients regarding TAA. Exclusion criteria included news articles, non-text materials (video), research manuscripts, industry websites, and articles not related to TAA. The readability of included articles was quantified using the validated Flesch-Kincaid Grade Level index. The PEMAT form (Figure 1) for printed materials was used to assess understandability and actionability using a 0-100 scale for both measures of interest. Spearman’s correlation coefficient was utilized to examine the relationship between a website’s average rank on Google (from first to last) and its readability, understandability, and actionability. P-values of less than 0.05 were considered significant. Results: Forty-one websites met inclusion criteria. The mean Flesch Kincaid reading grade level was 13.7+-15.3 (range: 6.3-16.8), with no website written at an elementary school level. Article readability scores were not associated with Google search rank (p>0.301). Mean understandability and actionability scores were 70.4+-15.3 and 24.4+-24.3, respectively. Among understandability categories, only 9.8% (n=4) included summaries and only 46.3% (n=19) included visual aids. Among actionability categories, 58.5% (n=24) of websites identified at least one action for readers, but only 16.7% (n=4) of these studies broke down actions into explicit, easy to understand steps. Higher actionability scores were significantly associated with earlier Google search rank (rho:- 0.44, p=0.004), while higher understandability scores were associated with later Google search rank (rho: 0.53, p<0.001). Conclusion: No website describing TAA was written at or below the nationally recommended 6th grade reading level. Overall, TAA online educational materials scored poorly with respect to readability, understandability, and actionability. Article actionability but not understandability correlated with an earlier Google search rank. In the era of shared decision making, it is vital that patients understand procedures, as well as the risks and benefits prior to undergoing elective surgery. These results suggest that current publicly available resources for TAA remain inadequate for patient education.

Sign in / Sign up

Export Citation Format

Share Document