scholarly journals When Rating Format Induces Different Rating Processes: The Effects of Descriptive and Evaluative Rating Modes on Discriminability and Accuracy

2014 ◽  
Vol 30 (4) ◽  
pp. 795-812 ◽  
Author(s):  
Laurent Cambon ◽  
Dirk D. Steiner
1992 ◽  
Vol 16 (2) ◽  
pp. 209-228 ◽  
Author(s):  
Asya Pazy

To investigate the idea that information about relevant career experience has an effect on the degree of sex bias in promotion decisions, an analogue study was conducted in which sex of candidate and relevance of prior jobs were varied. The effect of respondent's experience of subordinacy to a female manager was also investigated. A within-subject design was used with two response formats, ranking and rating. As predicted, relevance of career experience was a primary consideration in the promotion decision. Respondents who had worked in the past under a female manager showed a profemale bias in choosing among candidates with relevant career experience. No sex-linked bias was identified in the treatment of the candidates with irrelevant prior experience. Additional results suggested that the ranking format was more sensitive to the effect of sex-linked bias than was the rating format.


2001 ◽  
Vol 5 (2) ◽  
pp. 49-59
Author(s):  
Marilyn A Campbell ◽  
Ronald M Rapee ◽  
Susan H Spence

2005 ◽  
Vol 13 (2) ◽  
pp. 97-107 ◽  
Author(s):  
Gunna J. Yun ◽  
Lisa M. Donahue ◽  
Nicole M. Dudley ◽  
Lynn A. McFarland

2012 ◽  
Vol 7 (1) ◽  
pp. 88-107 ◽  
Author(s):  
José Borges ◽  
António C. Real ◽  
J. Sarsfield Cabral ◽  
Gregory V. Jones

AbstractAn impartial assessment of the quality of the wine produced over the years in a region (vintage quality) is an essential tool for producers, consumers, investors, and wine researchers to understand factors influencing quality and make purchasing or investing decisions. However, scoring the overall wine quality over the years does not necessarily produce a consensus of which year or years are best. Several critics, magazines, and organizations publish vintage charts that assign a score to each vintage, representing the corresponding perception of the wine quality. Often, the scores given by different institutions reveal little consensus with respect to the relative quality of the vintages.In this work, we propose the utilization of a rank aggregation method to combine a collection of vintage charts for a region into a ranking of the vintages that represents the consensus of the input vintage charts. As a result, we obtain an impartial ranking of the vintages that represents the consensus of an arbitrary number of independent vintage charts. We illustrate the method with the scores from three wine regions.The proposed method produces a ranking of vintage-to-vintage quality that represents an impartial consensus of a collection of independent sources, each using a different rating format, scale, or classification. Such a ranking has the potential to be useful for the research community, which needs a relative measure of wine production quality over the years. Therefore, we make publicly available a software tool that implements the method (Borges, 2011). (JEL Classification: C38, C61, C88)


1975 ◽  
Vol 67 (2) ◽  
pp. 226-237 ◽  
Author(s):  
Richard M. Jaeger ◽  
Tom D. Freijo
Keyword(s):  

1976 ◽  
Vol 13 (1) ◽  
pp. 1-14 ◽  
Author(s):  
Tom D. Freijo ◽  
Richard M. Jaeger

Two hypotheses were tested: (1) Teachers’ ratings of high-SES pupils will exhibit less composite halo than will teachers’ ratings of low-SES pupils, and (2) The SES of pupils will have a greater effect on composite halo in ratings than will the race of the pupil or teacher. Principal components analysis was used to investigate the hypotheses, using teachers’ ratings of more than 8,000 fourth-grade pupils on 21 related behavior changes. The hypotheses were confirmed. The results are at variance with one set of literature while in support of another set of literature. It was suggested that the relationships between social distance, race, SES, and evaluator accuracy (one example of which is absence of composite halo) be resurrected for closer scrutiny in the face of conflicting evidence.


1986 ◽  
Vol 58 (2) ◽  
pp. 607-614 ◽  
Author(s):  
Robert E. Thayer

The Activation-Deactivation Adjective Check List (AD ACL) is a multidimensional self-rating test constructed and extensively validated for rapid assessments of momentary activation or arousal states. The two core dimensions, energetic arousal (including tiredness) and tense arousal (including calmness) have been replicated repeatedly. They bear a complex relationship to each other involving positive and negative correlations at different levels of intensity. The dimensions are associated with a variety of arousal-related characteristics, including physiological changes, sleep-wake cycles, exercise effects, cognitive and information processing functions, various mood states, and a number of concomitants of stress. Finally, in a reported empirical study designed to investigate the somewhat uncommon self-rating format of this check list, alternative rating scales were employed with the same adjective descriptors. Factor analyses of respondents' ratings indicated that the factor structure of activation descriptors remained essentially the same with each scale. In this context, the importance of the underlying arousal model in relation to the activation descriptors is discussed.


Sign in / Sign up

Export Citation Format

Share Document