Write a Blog >>
ICST 2022
Mon 4 - Fri 8 April 2022
Wed 6 Apr 2022 15:15 - 15:30 at Margaret Hamilton - ICST AI II Chair(s): Donghwan Shin

Mutations are small, often token-level changes to program code, typically performed during mutation testing for evaluating the quality of test suites. Recently, code mutations have come in use for creating benchmarks of buggy code. Such bug benchmarks present valuable aids for the evaluation of testing, debugging or bug repair tools. Moreover, they can serve as training data for learning-based (neural) bug detectors. Key to all these applications is the creation of realistic bugs which closely resemble faults made by software developers. In this paper, we present a learning-based approach to mutation. We propose a novel contextual mutation operator which incorporates knowledge about the mutation context to inject natural and more realistic faults into code. Our approach employs a masked language model to produce a context-dependent distribution over feasible token replacements. The strategy for producing realistic mutations is thus learned. Our experimental evaluation on Java, JavaScript and Python programs shows that sampling from a language model does not only produce mutants which more accurately represent real bugs (with a reproduction score nearly 70% higher than for mutations employed in testing), but also lead to better performing bug detectors when trained on thus generated bug benchmarks.

Wed 6 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:15 - 16:30
ICST AI IITesting Tools / Research Papers / Industry at Margaret Hamilton
Chair(s): Donghwan Shin University of Luxembourg
Learning Realistic Mutations: Bug Creation for Neural Bug Detectors
Research Papers
Cedric Richter Carl von Ossietzky Universität Oldenburg / University of Oldenburg, Heike Wehrheim Carl von Ossietzky Universität Oldenburg / University of Oldenburg
SUPERNOVA: Automating Test Selection and Defect Prevention in AAA Video Games Using Risk Based Testing and Machine Learning
Alexander Senchenko Electronics Arts, Naomi Patterson Electronics Arts, Hamman Samuel Electronics Arts, Dan Ispir Electronics Arts
RiverGame - a game testing tool using artificial intelligence
Testing Tools
Ciprian Paduraru University of Bucharest, Miruna Gabriela Paduraru University of Bucharest , Alin Stefanescu University of Bucharest
Machine Learning Based Invariant Generation: A Framework and Reproducibility Study
Research Papers
Jan Haltermann University of Oldenburg, Heike Wehrheim Carl von Ossietzky Universität Oldenburg / University of Oldenburg
Live Q&A
Discussion and Q&A
Research Papers