Retest Reliability of Integrated Speed–Accuracy Measures

Assessment ◽  
2021 ◽  
pp. 107319112098560
Author(s):  
Tamar Bakun Emesh ◽  
Dror Garbi ◽  
Alon Kaplan ◽  
Hila Zelicha ◽  
Anat Yaskolka Meir ◽  
...  

Cognitive tasks borrowed from experimental psychology are often used to assess individual differences. A cardinal issue of this transition from experimental to correlational designs is reduced retest reliability of some well-established cognitive effects as well as speed–accuracy trade-off. The present study aimed to address these issues by examining the retest reliability of various methods for speed–accuracy integration and by comparing between two types of task modeling: difference scores and residual scores. Results from three studies on executive functions show that (a) integrated speed–accuracy scoring is generally more reliable as compared with nonintegrated methods: mean response time and accuracy; and (b) task modeling, especially residual scores, reduced reliability. We thus recommend integrating speed and accuracy, at least for measuring executive functions.

2012 ◽  
Vol 11 (3) ◽  
pp. 118-126 ◽  
Author(s):  
Olive Emil Wetter ◽  
Jürgen Wegge ◽  
Klaus Jonas ◽  
Klaus-Helmut Schmidt

In most work contexts, several performance goals coexist, and conflicts between them and trade-offs can occur. Our paper is the first to contrast a dual goal for speed and accuracy with a single goal for speed on the same task. The Sternberg paradigm (Experiment 1, n = 57) and the d2 test (Experiment 2, n = 19) were used as performance tasks. Speed measures and errors revealed in both experiments that dual as well as single goals increase performance by enhancing memory scanning. However, the single speed goal triggered a speed-accuracy trade-off, favoring speed over accuracy, whereas this was not the case with the dual goal. In difficult trials, dual goals slowed down scanning processes again so that errors could be prevented. This new finding is particularly relevant for security domains, where both aspects have to be managed simultaneously.


2006 ◽  
Vol 3 (10) ◽  
pp. 649-654 ◽  
Author(s):  
Dan Beamish ◽  
Shabana Ali Bhatti ◽  
I. Scott MacKenzie ◽  
Jianhong Wu

An intrinsic property of human motor behaviour is a trade-off between speed and accuracy. This is classically described by Fitts' law, a model derived by assuming the human body has a limited capacity to transmit information in organizing motor behaviour. Here, we propose an alternative foundation, based on the neurodynamics of the motor circuit, wherein Fitts' law is an approximation to a more general relationship. In this formulation, widely observed inconsistencies with experimental data are a consequence of psychomotor delay. The methodology developed additionally provides a method to estimate the delay within the motor circuit from the speed-accuracy trade-off alone.


1983 ◽  
Vol 5 (2) ◽  
pp. 189-196 ◽  
Author(s):  
Janet L. Starkes ◽  
Fran Allard

Volleyball players and nonplayers were compared for speed and accuracy of performance in a task involving detection of the presence of a volleyball in rapidly presented slides of a volleyball situation. Slides depicted both game and nongame situations, and subjects performed the task in both noncompetitive and competitive conditions. For all subjects, game information was perceived more quickly and accurately than nongame information. In competition all subjects showed decreased perceptual accuracy and no change in criterion, supporting the Easterbrook (1959) notion of perceptual narrowing with stress. Very large accompanying increases in response speed, however, suggested that competition may induce adoption of a particular speed-accuracy trade-off. Cognitive flexibility in the adoption of particular speed-accuracy trade-offs is discussed with reference to volleyball.


2020 ◽  
Vol 131 (4) ◽  
pp. e214
Author(s):  
A. Meyer ◽  
R. Graber ◽  
P. Calabrese ◽  
U. Gschwandtner ◽  
P. Fuhr

2020 ◽  
Vol 12 ◽  
Author(s):  
Yauhen Statsenko ◽  
Tetiana Habuza ◽  
Klaus Neidl-Van Gorkom ◽  
Nazar Zaki ◽  
Taleb M. Almansoori

Background: The current study examines the relationship between speed and accuracy of performance in a reaction time setting and explores the informative value of the inverse efficiency score (IES) regarding the possibility to reflect age-related cognitive changes.Objectives: To study the characteristics of speed and accuracy while performing psychophysiological tests throughout the lifespan; to examine the speed-accuracy ratio in age groups and to apply IES to discriminative visual-motor reaction task; and to figure out the predictive potential of psychophysiological tests to identify IES values.Methods: We utilize nonparametric statistical tests, regression analysis, and supervised machine learning methods.Results and Conclusion: The examinees under 20 and over 60 years of age share one tendency regarding the speed-accuracy ratio without speed-accuracy trade-off. Both at the time of active developmental changes in adolescence and during ongoing atrophic changes in elderly there is a tendency toward a rise of the number of mistakes while slowing the reaction. In the age range from 20 to 60 the relationship between the speed and accuracy is opposite and speed-accuracy trade-off is present. In our battery, complex visual-motor reaction is the only test with the significant negative association between reaction time and error rate in the subcohort of young and midlife adults taken together. On average, women perform more slowly and accurately than men in the speed-accuracy task, however most of the gender-related differences are insignificant. Using results of other psychophysiological tests, we predicted IES values for the visual-motor reaction with high accuracy (R2 = 0.77 ± 0.08; mean absolute error / IES range = 3.37%). The regression model shows the best performance in the cognitively preserved population groups of young and middle-aged adults (20–60 years). Because of the individual rate of neurodevelopment in youth and cognitive decline in the elderly, the regression model for these subcohorts has a low predictive performance. IES accounts for different cognitive subdomains and may reflect their disproportional changes throughout the lifespan. This encourages us to proceed to explore the combination of executive functioning and psychophysiological test results utilizing machine learning models. The latter can be designed as a reliable computer-aided detector of cognitive changes at early stages.


2017 ◽  
Author(s):  
Kinshuk Banerjee ◽  
Anatoly B. Kolomeisky ◽  
Oleg A. Igoshin

One of the most fascinating features of biological systems is the ability to sustain high accuracy of all major cellular processes despite the stochastic nature of underlying chemical processes. It is widely believed that such low errors are the result of the error correcting mechanism known as kinetic proofreading. However, it is usually argued that enhancing the accuracy should result in slowing down the process leading to so-called speed-accuracy trade-off. We developed a discrete-state stochastic framework that allowed us to investigate the mechanisms of the proofreading using the method of first-passage processes. With this framework, we simultaneously analyzed speed and accuracy of the two fundamental biological processes, DNA replication and tRNA selection during the translation. The results indicate that speed-accuracy trade-off is not always observed. However, when the trade-off is present, the biological systems tend to optimize the speed rather than the accuracy of the processes, as long as the error level is tolerable. Additional constraints due to the energetic cost of proofreading also play a role in the error correcting process. Our theoretical findings provide a new microscopic picture of how complex biological processes are able to function so fast with a high accuracy.


1997 ◽  
Vol 85 (2) ◽  
pp. 705-718 ◽  
Author(s):  
Chia-Fen Chi ◽  
Chia-Liang Lin

The current experiment examined the speed-accuracy trade-off of saccadic movement between two targets. Ten subjects looked alternately at two targets as fast and as accurately as possible for 2 min. under different conditions of target size, distance between targets, and direction of eye movement. Saccadic movement of the left eye was tracked and recorded with an infrared eye monitoring device to compute the starting position, ending position, and duration of each saccadic movement. Eye-movement time was significantly related to target size and distance between targets, but the speed-accuracy trade-off was significantly different from that predicted by Fitts' Law. Reaction time was not significantly changed by the direction of eye movement.


2020 ◽  
Vol 16 (5) ◽  
pp. 20200094 ◽  
Author(s):  
Ria Sonnleitner ◽  
Max Ringler ◽  
Matthias-Claudio Loretto ◽  
Eva Ringler

The trade-off between speed and accuracy affects many behavioural processes like predator avoidance, foraging and nest-site selection, but little is known about this trade-off relative to territorial behaviour. Some poison frogs are highly territorial and fiercely repel calling male intruders. However, attacks need to be conducted cautiously, as they are energetically costly and bear the risk of own injury or accidentally targeting the wrong individual. In this study, we investigated the speed–accuracy trade-off in the context of male territoriality during the breeding season in the brilliant-thighed poison frog, Allobates femoralis . In our experiment, we presented the call of an invisible ‘threatening’ intruder together with a visible ‘non-threatening’ intruder, using acoustic playback and a frog model, respectively. Contrary to our prediction, neither reaction time nor approach speed of the tested frogs determined the likelihood of erroneous attacks. However, younger individuals were more likely to attack the non-threatening model than older ones, suggesting that experience plays an essential role in identifying and distinguishing rivalling individuals in a territorial context.


Sign in / Sign up

Export Citation Format

Share Document