Write a Blog >>
ICST 2022
Mon 4 - Fri 8 April 2022
Wed 6 Apr 2022 09:45 - 10:00 at Margaret Hamilton - ICST Regression Testing Chair(s): Rachel Tzoref-Brill

Regression testing is an important task in any large software project, however as codebase increases, test suites grow and become composed of highly redundant test cases, thus greatly increasing the time required for testing. To solve this problem various test suite reduction tools have been proposed, however their absolute and relative performance are unclear to their prospective users, since there is a lack of a standardized evaluation or approach for choosing the best reduction tool. This work proposes TESRAC, a framework for assessing and comparing test suite reduction tools, which allows users to evaluate and rank a customizable set of tools in terms of reduction performance according to criteria (coverage, dimension, and execution time), and which can be configured to prioritize specific criteria. We used TESRAC to assess and compare three test suite reduction tools and one test suite prioritization tool that has been adapted to perform test suite reduction, across eleven projects of various dimensions and characteristics. Results show that a test suite prioritization tool can be adapted to perform a adequate test suite reduction, and a subset of tools outperforms the remaining tools for the majority of the projects. However, the project and test suite being reduced can have a strong impact on a tool’s performance.

Wed 6 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:45 - 11:00
ICST Regression TestingResearch Papers / Journal-First Papers / Industry at Margaret Hamilton
Chair(s): Rachel Tzoref-Brill IBM Research
09:45
15m
Talk
TESRAC: A Framework for Test Suite Reduction Assessment at Scale
Research Papers
João Becho LaSiGE & FCUL, University of Lisbon, Frederico Cerveira CISUC & DEI, University of Coimbra, João Leitão NOVA LINCS & FCT, NOVA University of Lisbon, Rui André Oliveira NOVA LINCS & FCT, NOVA University of Lisbon
10:00
15m
Talk
Less is More: Simplification of Test Scenarios for Autonomous Driving System Testing
Industry
Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang National Institute of Informatics, Japan, Fuyuki Ishikawa National Institute of Informatics
10:15
15m
Talk
An effective formulation of the multi-criteria test suite minimization problem
Journal-First Papers
Okan Orsan Ozener Özyeğin University, Hasan Sozer Ozyegin University
Link to publication DOI
10:30
15m
Talk
Dynamic test prioritization of product lines: An application on configurable simulation models
Journal-First Papers
Urtzi Markiegi Mondragon Unibertsitatea, Aitor Arrieta Mondragon University, Leire Etxeberria Mondragon Unibertsitatea, Goiuria Sagardui Mondragon University
Link to publication DOI
10:45
15m
Live Q&A
Discussion and Q&A
Research Papers