scholarly journals Comparison of test performance on paper-based testing (PBT) and computer-based testing (CBT) by English-majored undergraduate students in China

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Wenjing Yu ◽  
Noriko Iwashita

AbstractComputer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing mode impacted TEM 4 score and factors (i.e., computer familiarity level and attitude towards CBT) that might correlate with performance on CBT of TEM 4. Overall 92 Chinese undergraduate students were randomly assigned to one of the groups, i.e., CBT or paper-based testing (PBT), and took the test. A mixed method was employed, including (1) quantitative and qualitative analysis of test performance in two modes, as well as CBT group participants’ computer familiarity and attitudes towards the mode; and (2) thematic analysis of semi-structured interviews. The results revealed that (1) test scores in CBT and PBT were comparable; (2) two items in the computer familiarity questionnaire, i.e., comfort level of reading articles on the computer and forgetting time when using computers, positively correlated with CBT scores; and (3) participants’ attitude towards CBT did not impact test performance.

2017 ◽  
Vol 10 (2) ◽  
pp. 23 ◽  
Author(s):  
Hooshang Khoshsima ◽  
Monirosadat Hosseini ◽  
Seyyed Morteza Hashemi Toroujeni

Advent of technology has caused growing interest in using computers to convert conventional paper and pencil-based testing (Henceforth PPT) into Computer-based testing (Henceforth CBT) in the field of education during last decades. This constant promulgation of computers to reshape the conventional tests into computerized format permeated the language assessment field in recent years. But, enjoying advantages of computers in language assessment raise the concerns of the effects that computerized mode of testing may have on CBT performance. Thus, this study investigated the score comparability of Vocabulary in Use test taken by 30 Iranian undergraduate students studying at a state university located in Chabahar region of Iran (CMU) to see whether scores from two administrations of testing mode were different. Therefore, two similar tests were administered to the male and female participants on two testing mode occasions with four weeks interval. Employing One-Way ANOVA statistical test to compare the mean scores and Pearson Correlation test to find the relationship between mode preference and performance revealed that two sets of scores were not different and gender difference was not also considered a variable that might affect performance on CBT. Based on the results, computerized version of the test can be considered a favorable alternative for the state undergraduate students in Iran.


Author(s):  
Mohammad Reza Ebrahimi ◽  
Seyyed Morteza Hashemi Toroujeni ◽  
Vahide Shahbazi

Abstract—Score equivalency of two Computer-Based Testing (henceforth CBT) and Paper-and-Pencil-Based Testing (henceforth PBT) versions has turned into a controversial issue during the last decade in Iran. The comparability of mean scores obtained from two CBT and PBT formats of test should be investigated to see if test takers’ testing performance is influenced by the effects of testing administration mode. This research was conducted to examine score equivalency across modes as well as the relationship of gender, and testing mode preference with test takers’ performance on computerized testing. The information of testing mode preference and attitudes towards CBT and its features was supported by a focus group interview. Findings indicated that the scores of test takers were not different in both modes and there was no statistically significant relationship between moderator above variables and CBT performance.


Mousaion ◽  
2020 ◽  
Vol 37 (4) ◽  
Author(s):  
Nafisa Rabiu ◽  
Adetola Kehinde ◽  
Halimah Odunayo Amuda ◽  
Kehinde Kadijat Kadiri

This study investigated the perceptions of undergraduate students at the University of Ilorin, Nigeria, of the usefulness and challenges associated with computer-based testing. The population for the study consisted of undergraduate students at the University of Ilorin. According to the data collected from the Directorate of Academic Planning at the University of Ilorin, Nigeria, the population of undergraduate students for the 2017/2018 academic session was 43 983. A simple random sampling technique was used to select the sample. A questionnaire was used as data collection instrument. The findings from the study showed that using a web-based assessment system contributed positively to the undergraduate students’ academic achievements while the majority of them preferred taking all their exams with the web-based assessment system. The findings further revealed that to the undergraduate students, CBT is an interesting technique in examinations and makes the taking of examinations easier. Also, there is high level of competence among undergraduate students with regard to possession of the required skills for CBT examinations. Delays in the commencement of the exams, power failures at the CBT centre and overcrowding are major challenges encountered by the students taking CBT examinations. One of the study recommendations was that the university management should endeavour to eliminate the delays in the commencement of tests by providing assessment timetables which should be strictly adhered to.


Author(s):  
Volodymyr Starosta

The urgency of the research problem is due to the need to find new opportunities for computer-based testing, especially in the current context of the COVID-19 pandemic, when most higher education institutions operate in a distance learning environment. The aim of the article is to study the impact of retesting on the performance of students and postgraduate students on the example of studying some pedagogical disciplines in a classical university. The author used the following research methods: theoretical - in order to understand the features of computer-based testing of students in high school, formulating the conclusions of the study, etc. (analysis and synthesis, comparison, generalization, etc.); empirical – to develop didactic tests and identify indicators of initial and re-testing of students and postgraduate students (online survey, pedagogical observation); mathematical – to process the results using the computer program IBM SPSS Statistics 23. The author obtained the following specific results: according to an online survey of 1211 respondents (during 2020), almost 67% of undergraduate students, 70% of undergraduates and 83% of university students study in Moodle most disciplines during the COVID-19 pandemic. The Moodle system is most prevalent in distance learning during the COVID-19 pandemic at the university. The coefficients of internal consistency (Cronbach’s alpha) of the developed tests are equal to 0,80-0,94 for different disciplines. Students and postgraduate students took the mandatory first test at Moodle, and they also had the opportunity to retake the test of their choice. Retesting helps to improve the performance of students and postgraduate students. The average increase in test score (%) between the test and re-test was in the range of 2 -16 for various disciplines (2-14 for bachelor’s students, 11-16 for master’s students, 3-5 for postgraduate students).


2021 ◽  
Vol 9 (2) ◽  
Author(s):  
Saeideh Daryazadeh ◽  
Atiye Faghihi

Background: In the modern era, the use of new technology is rapidly expanding, and the area of measurement and assessment in medical sciences has also been affected. Considering the increasing use of computer-based testing (CBT), and the viewpoint and experiences of students are paramount in this regard. Objectives: The present study aimed to describe the experiences of medical students regarding CBT. Methods: This qualitative research was conducted using conventional content analysis during 2018 - 2019. The participants included 10 pre-internship medical students who were selected via purposive sampling. Data were collected via semi-structured interviews, and data analysis was performed in MAXQDA 10. Results: Data analysis eventually led to the emergence of two themes, which were examinee-related components that consisted of two categories (experimental and preferred aspects) and test related components that consisted of three categories (technical, financial, and executive aspects). In addition, each category had subcategories. Conclusions: The participants stated their experiences with CBT from different perspectives. Accordingly, CBT could be a proper alternative to paper-based testing if the weaknesses were resolved. Therefore, it is suggested that other CBTs be evaluated similar to the present study to investigate the views of the stakeholders involved in the assessment system.


Computer Based Testing has become a prominent method in student assessment in Nigeria and student perception on this testing technique is paramount. This study examined the perception of undergraduate students towards computer based testing by comparing several modules studied by Undergraduate students in Nigeria which constitutes a major gap in literature. Results showed that majority of students preferred computer based testing to paper based testing but were not will to adopt this technique in all courses. Results further showed majority of students showed preference to paper based tests in Mathematics more than 50% of students had below average grades when the CBT technique was implemented. Similarly, students showed poor grades in Mathematics, Chemistry and Physics, results further showed the relationship between computer and anxiety and performance in in Mathematics .This study has implications for university administrators in the creation of policies for Computer based testing


Author(s):  
Hooshang Khoshsima ◽  
Seyyed Morteza Hashemi Toroujeni

The empirical evidences show that two identical Computer-Based Testing (henceforth CBT) and Paper-and-Pencil-Based Testing (henceforth PBT) do not always result in the same scores. Such conclusions are referred to as “the effect of testing administration mode” or “testing mode effect”. Moderators such as individual differences (e.g., prior computer experience or computer attitude) have been investigated [4] to see if they influence test takers’ performance. The Guidelines for Computer-Based Tests and Interpretations [1] recommended eliminating the possible effects of some moderator variables on test takers performance. This research was conducted to provide the required empirical evidences on the existence of distinctive effects caused by changing administration mode from conventional PBT to modern CBT. The relationship between testing mode preference on test takers’ CBT performance was also examined. Two equivalent tests and two questionnaires were used. Using descriptive statistics and ANOVA, the findings demonstrated that two CBT and PBT sets of scores were comparable. Additionally, prior testing mode preference and gender had no significant effect on test takers’ CBT score, and they were not considered the variables that might affect the performance on CBT.


Sign in / Sign up

Export Citation Format

Share Document