Performance-Based Evaluation Metrics: Influence at the Macro, Meso, and Micro Level

This chapter aims to critically engage with the performative nature of bibliometric indicators and explores how they influence scholarly practice at the macro, meso, and individual levels. It begins with a comparison between two national performance-based funding systems in Sweden and Norway at the macro level, within universities at the meso level, down to the micro level where individual researchers must relate these incentives to knowledge building within their specialty. I argue that the common-sense “representational model of bibliometric indicators” is questionable in practice, since it cannot capture the qualities of research in any unambiguous way. Furthermore, a performative notion on scientometric indicators needs to be developed that takes into account the variability and uncertainty of the aspects of research that is to be evaluated.

Total Edentulism and Its Epidemiological Surveillance in Oaxaca, Mexico from 2009–2019

Total edentulism is the loss of all teeth for any cause by a multifactorial process that involves biological and patient-related factors. Studies on edentulism and risk factors in Mexico are limited, and the epidemiological surveillance data is scarce and controversial since official governmental reports are not statistically representative of the country. We estimate the distribution for edentulism according to sociodemographic and socioeconomic variables in adults from a low-income state in 2003 and its progress in Mexico. We analyzed data from the National Performance Evaluation Survey in Oaxaca, Mexico, and the annual reports of the Epidemiological Surveillance System of Oral Pathologies in 2009–2019 using X2. Oaxacan patients older than 75 y.o. (17.9%, p < 0.05), those with lower schooling (11.2%), and diabetes (14.5%) presented the highest percentage of edentulism. We do not observe differences in edentulism between sex or residence (p > 0.05). From 2009 to 2019, country data reports the lowest rate of edentulism in adults over 20 y.o. (0.32%; 95% CI 0.18–0.48%) and the most affected population over 79 y.o. (7.29%; 95% CI 5.2–9.30%). As it is a cumulative phenomenon, it is necessary to establish better surveillance, prevention, and treatment programs to improve the oral health of older thus reducing edentulism.

Total Edentulism and Its Epidemiological Surveillance in Oaxaca, Mexico from 2009–2019.

Total edentulism is the loss of all teeth for any cause by a multifactorial process that involves biological and patient-related factors. Studies on edentulism and risk factors in Mexico are limited, and the epidemiological surveillance data is scarce and controversial since official governmental reports are not statistically representative of the country. We estimate the distribution for edentulism according to sociodemographic and socioeconomic variables in adults from a low-income state in 2003 and its progress in Mexico. We analyzed data from the National Performance Evaluation Survey in Oaxaca, Mexico, and the annual reports of the Epidemiological Surveillance System of Oral Pathologies in 2009-2019 using X2. Oaxacan patients older than 75 y.o (17.9%, p&lt;0.05), those with lower schooling (11.2%), and diabetes (14.5%) presented the highest percentage of edentulism. We do not observe differences in edentulism between sex or residence (p&gt;0.05). From 2009 to 2019, country data reports the lowest rate of edentulism in adults over 20 y.o (0.32%; 95% CI 0.18%-0.48%) and the most affected population over 79 y.o. (7.29%; 95% CI 5.2%-9.30%). As it is a cumulative phenomenon, it is necessary to establish better surveillance, prevention, and treatment programs to improve the oral health of older thus reducing edentulism.

Environmental Performance in EU Countries from the Perspective of Its Relation to Human and Economic Wellbeing

The actual development challenges impose new criteria of national performance evaluation, the concept of wellbeing tending to be measured not just in terms of economic and social dimensions, but also vs. the environment. Accordingly, considering the national environmental performance among the EU countries in 2006–2019 period, we grouped them and concentrated on the clusters registering the highest and lowest levels, analyzing how the components of the human and economic dimensions influence it. Applying panel data models, our main results emphasized that, firstly, for the countries with a better environmental performance, sufficient drinking water, safe sanitation, education, gender equality, and good governance were significant; in the countries with the lowest levels of environmental wellbeing, sufficient food, sufficient to drink, education, and income distribution were insignificant, while the remaining components were relevant. Secondly, in both groups of countries, organic farming and public debt were significant; nevertheless, differences were observed for genuine savings and employment, for which the peculiarities of economic activities seemed to be materialized as different influences upon environmental wellbeing. Our study draws alarm signals regarding the development patterns applied in the EU, seeming to have results that strengthen the sustainable goals, but not sufficient for exceeding the traditional growth-oriented model.

Predictors of superior performance in coaches – the role of A-trait

Anxiety represents a multifaceted response that can hinder or help performance. Anxiety experienced at high intensity and in the long term is a noxious phenomenon. However, moderate anxiety can lead to improved performance, stimulating on-task effort. The aims of our study are to determine the pattern of anxious reactions in coaches with superior results in competition and to identify which facet of anxiety is a better predictor of sports performance. A total of 57 coaches (19 women and 38 men) participated in the research. We assessed four facets of trait anxiety using the Endler Multidimensional Anxiety Scales. The results highlight significantly lower scores in successful coaches compared to novice coaches for anxiety in new situations and in separation conditions. When talking about anxiety in physically dangerous and sociallyevaluative circumstances, no significant differences were found between the two groups of coaches (successful and beginner ones). After performing two separate binomial logistic regressions, we can argue that the scores for anxiety in separation conditions are a better predictor of sports performance than anxiety in new situations, the model explaining 30% of the variance in international or national performance and correctly classifying 75.4% of cases. The conclusions of our study represent valuable resources for sports psychologists, future (and current) coaches and researchers who are eager to better understand the impact of A-trait on sports performance, in the case of coaches.

Examining organisational responses to performance-based financial incentive systems: a case study using NHS staff influenza vaccination rates from 2012/2013 to 2019/2020

ObjectiveFinancial incentives are often applied to motivate desirable performance across organisations in healthcare systems. In the 2016/2017 financial year, the National Health Service (NHS) in England set a national performance-based incentive to increase uptake of the influenza vaccination among frontline staff. Since then, the threshold levels needed for hospital trusts to achieve the incentive (ie, the targets) have ranged from 70% to 80%. The present study examines the impact of this financial incentive across eight vaccination seasons.DesignA retrospective observational study examining routinely recorded rates of influenza vaccination among staff in all acute NHS hospital trusts across eight vaccination seasons (2012/2013–2019/2020). The number of trusts included varied per year, from 127 to 137, due to organisational changes. McCrary’s density test is conducted to determine if the number of hospital trusts narrowly achieving the target by the end of each season is higher than would be expected in the absence of any responsiveness to the target. We refer to this bunching above the target threshold as a ‘threshold effect’.ResultsIn the years before a national incentive was set, 9%–31% of NHS Trusts reported achieving the target, compared with 43%–74% in the 4 years after. Threshold effects did not emerge before the national incentive for payment was set; however, since then, threshold effects have appeared every year. Some trusts report narrowly achieving the target each year, both as the target rises and falls. Threshold effects were not apparent at targets for partial payments.ConclusionsWe provide compelling evidence that performance-based financial incentives produced threshold effects. Policymakers who set such incentives are encouraged to track threshold effects since they contain information on how organisations are responding to an incentive, what enquiries they may wish to make, how the incentive may be improved and what unintended effects it may be having.

1643 Quality Assessment of Intra-Oral Radiography Within Two Hospitals in South Wales, UK: A Two-Cycle Audit and Introduction to The Updated 2020 Public Health England Quality Grading System

Aim To evaluate the quality of intra-oral radiographs taken within two hospitals in South Wales, United Kingdom, and assess the impact of radiographer training, with the aim of reducing the percentage of undiagnostic radiographs to 10% or less in accordance with national performance targets. Method Details of intra-oral periapical and occlusal radiographs taken in the two hospitals between the 1st July 2015 and the 30th June 2016 were retrieved. 100 radiographs were randomly selected and assessed. Change was then implemented in the delivery of radiographer training workshops, which involved two hours of both didactic teaching and hands-on skills training. There were 10 workshops and 52 attendees. A second audit cycle was completed, with a further 100 radiographs randomly selected from the 1st December 2018 and 30th April 2019. Results There was a 33.2% reduction of undiagnostic radiographs, bringing the total down to 6.3%, meeting the standards of the audit. Feedback from the workshops were also extremely positive; 50% of radiographers grading the quality of the workshops at 10/10. Conclusions The workshops were successful in improving the quality of intra-oral radiographs, therefore improving the quality of this service. This blueprint can be shared amongst other hospitals, to sustainably improve the overall quality of dental radiography in the hospital setting. Recent updated guidance in 2020 introduced a new two-point scale radiograph grading system: ‘Acceptable’ and, ‘not acceptable’. Radiographs graded as, ‘not acceptable’, should account for no more than 5% of radiographs. Future audit cycles will follow this new grading system and standard.

COMPARATIVE ANALYSIS OF EVIDENCE-BASED POLICIES IN THE ERA OF DIGITALISATION

Digital transformation speeds up and strengthens an already growing demand for a well-functioning public administration with e-governmental services. The outbreak of the global Covid-19 pandemic edged such actions forward even more. Public administration with embedded institutions enables the formulation of a competitive environment. The implication of digital services can decrease the negative effects of an economic crisis. Evidence-based policy-making is a component of good governance next to transparency, sustainability, efficiency, integrity and an approach of being people-centric. Digitalisation brings new challenges for public service and governments are taking various measures in response to them. There is an evolving need for citizen-centric electronic public administration services. National performance can be expansively analysed in a globalised world – with international comparisons. The paper conducts an international comparative analysis about the developments of citizen-centric digital transformation in public administration after 2014 with special focus on Hungary and selected reference countries.