Parallel Test Prioritization

Although regression testing is important to guarantee the software quality in software evolution, it suffers from the widely known cost problem. To address this problem, existing researchers made dedicated efforts on test prioritization, which optimizes the execution order of tests to detect faults earlier; while practitioners in industry leveraged more computing resources to save the time cost of regression testing. By combining these two orthogonal solutions, in this article, we define the problem of parallel test prioritization, which is to conduct test prioritization in the scenario of parallel test execution to reduce the cost of regression testing. Different from traditional sequential test prioritization, parallel test prioritization aims at generating a set of test sequences, each of which is allocated in an individual computing resource and executed in parallel. In particular, we propose eight parallel test prioritization techniques by adapting the existing four sequential test prioritization techniques, by including and excluding testing time in prioritization. To investigate the performance of the eight parallel test prioritization techniques, we conducted an extensive study on 54 open-source projects and a case study on 16 commercial projects from Baidu , a famous search service provider with 600M monthly active users. According to the two studies, parallel test prioritization does improve the efficiency of regression testing, and cost-aware additional parallel test prioritization technique significantly outperforms the other techniques, indicating that this technique is a good choice for practical parallel testing. Besides, we also investigated the influence of two external factors, the number of computing resources and time allowed for parallel testing, and find that more computing resources indeed improve the performance of parallel test prioritization. In addition, we investigated the influence of two more factors, test granularity and coverage criterion, and find that parallel test prioritization can still accelerate regression testing in parallel scenario. Moreover, we investigated the benefit of parallel test prioritization on the regression testing process of continuous integration, considering both the cumulative acceleration performance and the overhead of prioritization techniques, and the results demonstrate the superiority of parallel test prioritization.

A Survey on Problem Formulations and (Meta)Heuristic-Based Solutions in Automated Assembly of Parallel Test Forms

Parallel test forms are ubiquitous in the educational, aptitude, achievement, and licensure testing. The problem of automated assembling of parallel test forms has been extensively explored for almost 40 years. Many different mathematical models of the problem formulations and a plenty of different solutions have emerged over the last two decades, indicating that the problem has matured. However, its investigation is still challenging, especially today, when the importance of distance learning and remote knowledge testing is rapidly growing. The diversity of proposed approaches originated notably from the variety of scientific fields involved such as psychometrics, applied mathematics, operations research, and artificial intelligence. Majority of solutions of the problem are (meta)heuristics-based, since they consider the problem as a combinatorial optimization problem which is NP-hard. In this paper, a comprehensive review of this research field, referring to related works since 1985, is conducted. Problem formulations and solutions of the problem are separately classified. Possible avenues of future research are pointed out.

Determining Adsorption Parameters of Potentially Contaminant-Releasing Materials Using Batch Tests with Differing Liquid-Solid Ratios

Adsorption parameters such as the distribution coefficient are required to predict the release behavior of contaminants using advection-dispersion models. However, for potentially contaminant-releasing materials (PCMs) such as dredged sludge and coal ash, these parameters cannot be obtained by conventional adsorption tests. This study developed a method to determine adsorption parameters for PCMs from a set of batch tests conducted in parallel as a function of the liquid-solid ratio (LS-parallel test). This LS-parallel test was performed on sandy soil derived from marine sediment using liquid-solid ratios from 1 to 300 L/kg. The water-contact time was also changed from 10 min to 28 d to elucidate the kinetics or equilibrium of contaminants released from the sample. Adsorption parameters were successfully obtained if the substance was under adsorption control. A column percolation test was performed to confirm the effectiveness of the obtained parameters. Good agreements were observed for SO42− and B, but discrepancies remained for other substances such as F− and as suggesting that improvements are necessary in both the LS-parallel test procedure and the advection-dispersion model.

Serum complement 3 is a potential biomarker for assessing disease activity in Takayasu arteritis

Background Takayasu arteritis (TA) is a rare disease, lacking convenient and feasible biomarkers to identify disease activity. We aimed to evaluate the value of complements in distinguishing active TA. Methods Consecutive patients were enrolled from the prospective East China TA cohort from April 2008 to June 2019. Patients were divided into two groups according to their baseline Kerr score. The value of complements and other biomarkers in identifying disease activity were analysed with cluster analysis, ROC curves, and combined tests. An independent group of patients from July 2019 to December 2019 were employed to validate the results. Results Of the enrolled 519 patients, 406 (72.2%) cases were identified as active disease. Higher erythrocyte sedimentation rate (ESR), C-reactive protein (CRP), interleukin-6 (IL-6), and complement 3 (C3) levels were observed in the active group. Elevated C3 (≥ 1.085 g/L) had a high value to identify active TA with a sensitivity of 69.9%, specificity of 66.7%, and AUC of 0.715. Combining the CRP (≥ 10.65 g/L; sensitivity, 50.7%; specificity, 82.4%) and C3, the sensitivity could be improved to 85.1% in parallel test and the specificity could be improved to 94.1% in serial test. Validation was further performed to confirm the value of C3 for disease activity assessment. The accuracy of the parallel test of CRP and C3 in external validation with independent 53 TA cases was 72.73% with the AUC of 0.721. Conclusion Elevated C3 could effectively evaluate the disease activity of TA, and C3 combining with CRP could further improve the disease activity evaluation.

Task Scheduling for Multiunit Parallel Test Using Mixed-Integer Linear Programming

Parallel test is an efficient approach for improving test efficiency in the aerospace field. To meet the challenges of implementing multiunit parallel test in practical projects, this paper presented a mixed-integer linear programming (MILP) model for solving the task scheduling problem. A novel sequence-based iterative (SBI) method is proposed to solve the model in reasonable time. The SBI method is composed of an implied sequence finding procedure (ISF) and a sequence-based iterative optimization (SBIO) procedure. The first procedure can reduce the search space by fixing free sequence variables according to the original test flowcharts, and the second procedure can solve the model iteratively in a reasonable amount of time. In addition, two indexes, namely, speed rate and average resource utilization rate, are introduced to evaluate the proposed methods comprehensively. Computational results indicate that the proposed method performs well in real-world test examples, especially for larger examples that cannot be solved by the full-space method. Furthermore, it is proved that the essence of the parallel test is trading space for time.

Serum complement 3 is a potential biomarker for assessing disease activity in Takayasu arteritis

Background. Takayasu arteritis (TA) is a rare disease, lacking convenient and feasible biomarkers to identify disease activity. We aimed to evaluate the value of complements in distinguishing active TA. Methods. Consecutive patients were enrolled from the prospective East China TA cohort from April 2008 to June 2019. Patients were divided into two groups according to their baseline Kerr score. The value of complements and other biomarkers in identifying disease activity were analysed with cluster analysis, ROC curves, and combined tests. An independent group of patients from July 2019 to December 2019 were employed to validate the results.Results. Of the enrolled 519 patients, 406 (72.2%) cases were identified as active disease. Higher erythrocyte sedimentation rate (ESR), C-reactive protein (CRP), interleukin-6 (IL-6), and complement 3 (C3) levels were observed in the active group. Elevated C3 (≥1.085 g/L) had a high value to identify active TA with a sensitivity of 69.9%, specificity of 66.7% and AUC of 0.715. Combining the CRP (≥10.65 g/L; sensitivity, 50.7%; specificity, 82.4%) and C3, the sensitivity could be improved to 85.1% in parallel test and the specificity could be improved to 94.1% in serial test. Validation was further performed to confirm the value of C3 for disease activity assessment. The accuracy of the parallel test of CRP and C3 in external validation with independent 53 TA cases was 72.73% with the AUC of 0.721. Conclusion. Elevated C3 could effectively evaluate the disease activity of TA, and C3 combining with CRP could further improve the disease activity evaluation.