The Testing Tools Track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of the art and the state of the practice. The track invites submissions that describe tools at several stages of maturity, including promising research prototypes, widely used research tools, and commercial tools (if they contribute to the scientific knowledge). This track seeks submissions from both academia and industry to foster discussions between researchers and practitioners.
The submission details:
- Testing tool paper (max 10 pages + references) and a demo video of 3-5 mins
Accepted papers will be published in ICST conference proceedings.
Tue 5 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
09:45 - 10:15 | |||
09:45 30mDay opening | Opening Research Papers |
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST Automated Testing ITesting Tools / Research Papers at Margaret Hamilton Chair(s): Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit | ||
11:30 15mTalk | Applying Symbolic Execution to Test Implementations of a Network Protocol Against its Specification Research Papers Hooman Asadian Uppsala University, Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden Pre-print | ||
11:45 15mTalk | Model-based Testing of Scratch Programs Testing Tools Katharina Götz University of Passau, Patric Feldmeier University of Passau, Gordon Fraser University of Passau | ||
12:00 15mTalk | CITRUS: Automated Unit Testing Tool for Real-world C++ Programs Testing Tools | ||
12:15 15mTalk | Symbolic Verification of Message Signatures in MPI Research Papers Hengbiao Yu National University of Defense Technology, Banghu Yin National University of Defense Technology, Xin Yi National University of Defense Technology | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:00 - 15:15 | ICST Field / Production testingResearch Papers / Industry at Margaret Hamilton Chair(s): Annibale Panichella Delft University of Technology | ||
14:00 15mTalk | Testing Software in Production Environments with Data from the Field Research Papers Luca Gazzola Università degli Studi di Milano-Bicocca, Leonardo Mariani University of Milano-Bicocca, Matteo Orru University of Milano Bicocca, Mauro Pezze USI Lugano; Schaffhausen Institute of Technology, Martin Tappler TU Graz; Silicon Austria Labs | ||
14:15 15mTalk | Automatic Error Classification and Root Cause Determination while Replaying Recorded Workload Data at SAP HANA Industry Neetha Jambigi University of Innsbruck, Thomas Bach SAP, Felix Schabernack SAP, Michael Felderer University of Innsbruck | ||
14:30 15mTalk | FAUSTA: Scaling Dynamic Analysis with Traffic Generation at WhatsApp Industry Ke Mao Meta, Timotej Kapus Facebook, Inc., Lambros Petrou Facebook, Inc., Ákos Hajdu Facebook, Matteo Marescotti Facebook, Inc., Andreas Löscher Facebook, Inc., Mark Harman Facebook, Inc., Dino Distefano Facebook London | ||
14:45 15mTalk | Smoke Testing of Cloud Systems Research Papers | ||
15:00 15mLive Q&A | Discussion and Q&A Research Papers |
15:15 - 15:45 | |||
15:15 30mBreak | Break/Networking Research Papers |
15:45 - 16:45 | ICST AI IResearch Papers / Industry at Margaret Hamilton Chair(s): Raihana Ferdous Fondazione Bruno Kessler | ||
15:45 15mTalk | IFRIT: Focused Testing through Deep Reinforcement Learning Research Papers Andrea Romdhana DIBRIS - University of Genoa, FBK - Security & Trust unit, Mariano Ceccato University of Verona, Alessio Merlo DIBRIS - University of Genoa, Paolo Tonella USI Lugano | ||
16:00 15mTalk | Robustness assessment and improvement of a neural network for blood oxygen pressure estimation Industry Paolo Arcaini National Institute of Informatics
, Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Daniele Gamba AISent S.r.l., Rita Pedercini AISent S.r.l. Pre-print | ||
16:15 15mTalk | Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests Research Papers Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield | ||
16:30 15mLive Q&A | Discussion and Q&A Research Papers |
16:45 - 17:00 | |||
16:45 15mBreak | Break/Networking Research Papers |
17:00 - 18:00 | |||
17:00 60mSocial Event | Pubquiz I Research Papers |
18:00 - 19:30 | |||
18:00 90mBreak | Break/Networking Research Papers |
19:30 - 20:45 | ICST GUI Testing and FuzzingResearch Papers / Tool Demos at Margaret Hamilton Chair(s): Andrea Stocco Università della Svizzera italiana (USI) | ||
19:30 15mTalk | A Framework for Automated API Fuzzing at Enterprise Scale Research Papers Riyadh Mahmood The Aerospace Corporation, Jay Pennington The Aerospace Corporation, Danny Tsang The Aerospace Corporation, Tan Tran The Aerospace Corporation, Andrea Bogle The Aerospace Corporation | ||
19:45 15mTalk | GUI Test Transfer from Web to Android Research Papers | ||
20:00 15mTalk | DTLS-Fuzzer: A DTLS Protocol State Fuzzer Tool Demos Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden, Fredrik Tåkvist Uppsala University Pre-print Media Attached | ||
20:15 15mTalk | Automated Detection of TalkBack Interactive Accessibility Failures in Android Applications Research Papers Ali S. Alotaibi University of Southern California, Paul T. Chiou University of Southern California, William G.J. Halfond University of Southern California | ||
20:30 15mLive Q&A | Discussion and Q&A Research Papers |
Wed 6 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST Fuzzing and Random TestingResearch Papers / Journal-First Papers / Industry at Margaret Hamilton Chair(s): Marcel Böhme MPI-SP, Germany and Monash University, Australia | ||
11:30 15mTalk | Metamorphic Fuzzing of C++ Libraries Research Papers Andrei Lascu Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, Torsten Hoefler ETH Zurich | ||
11:45 15mTalk | POWER: Program Option-Aware Fuzzer for High Bug Detection Ability Research Papers Ahcheong Lee KAIST, Irfan Ariq KAIST, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc. | ||
12:00 15mTalk | Comparing Fuzzers on a Level Playing Field with FuzzBench Industry Dario Asprone University College London (UCL), Jonathan Metzman Google, Abhishek Arya Google, Giovani Guizzo University College London, Federica Sarro University College London | ||
12:15 15mTalk | SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs Journal-First Papers Muhammad Ashfaq Jiangsu University, Rubing Huang Macau University of Science and Technology (MUST), Dave Towey University of Nottingham Ningbo China, Michael Omari Takoradi Technical University, Dmitry Yashunin Harman X, Patrick Kwaku Kudjo University of Professional Studies, Accra-Ghana, Tao Zhang Macau University of Science and Technology (MUST) Link to publication DOI | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:45 - 15:15 | |||
14:45 30mSocial Event | Ice-Breakers and Get to know each other Research Papers |
16:30 - 16:45 | |||
16:30 15mBreak | Break/Networking Research Papers |
16:45 - 18:00 | ICST Empirical StudyJournal-First Papers / Research Papers at Margaret Hamilton Chair(s): Mohammad Reza Mousavi King's College London | ||
16:45 15mTalk | An experimental and practical study on the equivalent mutant connection: An evolutionary approach Journal-First Papers Link to publication DOI | ||
17:00 15mTalk | A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests Research Papers Sarra Habchi University of Luxembourg, Luxembourg, Guillaume Haben University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg Pre-print | ||
17:15 15mTalk | As Code Testing: Characterizing Test Quality in Open Source Ansible Development Research Papers Pre-print File Attached | ||
17:30 15mTalk | A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It Research Papers Pre-print | ||
17:45 15mLive Q&A | Discussion and Q&A Research Papers |
18:00 - 19:30 | |||
18:00 90mBreak | Break/Networking Research Papers |
19:30 - 20:45 | ICST Automated Testing 2Research Papers / Journal-First Papers at Margaret Hamilton Chair(s): José Campos University of Lisbon, Portugal | ||
19:30 15mTalk | Providing Real-time Assistance for Repairing Runtime Exceptions using Stack Overflow Posts Research Papers | ||
19:45 15mTalk | To Seed or Not to Seed? An Empirical Analysis of Usage of Seeds for Testing in Machine Learning Projects Research Papers Saikat Dutta University of Illinois at Urbana-Champaign, Anshul Arunachalam University of Illinois at Urbana-Champaign, Sasa Misailovic University of Illinois at Urbana-Champaign | ||
20:00 15mTalk | Integration testing for robotic systems Journal-First Papers Maria Brito Federal University of Lavras Lavras, Simone do Rocio Senger de Souza ICMC/USP, Paulo Sergio Lopes de Souza ICMC/USP Link to publication DOI | ||
20:15 15mTalk | Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance Research Papers | ||
20:30 15mLive Q&A | Discussion and Q&A Research Papers |
Thu 7 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:00 - 11:00 | ICST Machine and Constraints LearningResearch Papers / Journal-First Papers at Margaret Hamilton Chair(s): Gunel Jahangirova USI Lugano | ||
10:00 15mTalk | Documentation-based functional constraint generation for library methods Journal-First Papers Renhe Jiang Nanjing University, Zhengzhao Chen Nanjing University, Yu Pei Hong Kong Polytechnic University, Minxue Pan Nanjing University, Tian Zhang Nanjing University, Xuandong Li Nanjing University Link to publication DOI | ||
10:15 15mTalk | Learning-based mutant reduction using fine-grained mutation operators Journal-First Papers Link to publication DOI | ||
10:30 15mTalk | An Empirical Study of IR-based Bug Localization for Deep Learning-based Software Research Papers Misoo Kim Sungkyunkwan University, Youngkyoung Kim Sungkyunkwan University, Eunseok Lee Sungkyunkwan University | ||
10:45 15mLive Q&A | Discussion and Q&A Research Papers |
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST API Testing and Program RepairIndustry / Research Papers at Margaret Hamilton Chair(s): Thomas Durieux KTH | ||
11:30 15mTalk | Harvesting Production GraphQL Queries to Detect Schema Faults Research Papers Louise Zetterlund Redeye AB, Deepika Tiwari KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology, Benoit Baudry KTH | ||
11:45 15mTalk | Automated Repair of Responsive Web Page Layouts Research Papers Ibrahim Althomali The University of Sheffield, Gregory Kapfhammer Allegheny College, Phil McMinn University of Sheffield | ||
12:00 15mTalk | Repairing Fragile GUI Test Cases Using Word and Layout Embedding Industry Juyeon Yoon Korea Advanced Institute of Science and Technology, Seungjun Chung KAIST, Kihyuck Shin Samsung Electronics, Jinhan Kim KAIST, Shin Hong Handong Global University, Shin Yoo KAIST | ||
12:15 15mTalk | Testing a PL/I Compiler using Precomputation-based Program Generation Industry Jesse Postema Universiteit Van Amsterdam, Johan Fabry Raincode Labs, Belgium, Yannick Barthol Raincode Labs, Ana Oprescu University of Amsterdam | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:45 - 15:15 | |||
14:45 30mBreak | Break/Networking Research Papers |
15:15 - 16:15 | ICST Test GenerationTesting Tools / Research Papers at Margaret Hamilton Chair(s): Xavier Devroey University of Namur | ||
15:15 15mTalk | TACKLETEST: A Tool for Amplifying Test Generation via Type-Based Combinatorial Coverage Testing Tools Rachel Tzoref-Brill IBM Research, Saurabh Sinha IBM Research, Antonio Abu Nassar IBM Research, Victoria Goldin IBM Research, Haim Kermany IBM Research | ||
15:30 15mTalk | JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs Research Papers Man Zhang Kristiania University, Asma Belhadi Kristiania University College, Andrea Arcuri Kristiania University College and Oslo Metropolitan University | ||
15:45 15mPaper | Assessor: a PO-Based WebDriver Test Suites Generator from Selenium IDE Recordings Testing Tools Maurizio Leotta DIBRIS, University of Genova, Italy, Antonio Molinari Università di Genova, Filippo Ricca Università di Genova | ||
16:00 15mLive Q&A | Discussion and Q&A Research Papers |
16:15 - 16:45 | |||
16:15 30mBreak | Break/Networking Research Papers |
16:45 - 18:00 | ICST Symbolic executionResearch Papers / Industry / Testing Tools / Journal-First Papers at Margaret Hamilton Chair(s): Arie van Deursen Delft University of Technology, Netherlands | ||
16:45 15mTalk | Translating EULYNX SysML models into Symbolic Transition Systems for Model-Based Testing of Railway signaling systems Industry Tobias Bachmann Universiteit van Amsterdam, Machiel van der Bijl Axini, Daan van der Meij ProRail, Djurre van der Wal University of Twente, Ana Oprescu University of Amsterdam | ||
17:00 15mTalk | Model checking C++ programs Journal-First Papers Felipe R. Monteiro Amazon, Mikhail R. Gadelha Igalia, Lucas C. Cordeiro University of Manchester, UK Link to publication DOI | ||
17:15 15mTalk | SIFT: A Tool for Property Directed Symbolic Execution of Multithreaded Software Testing Tools Tuba Yavuz University of Florida | ||
17:30 15mTalk | Automating Differential Testing with Overapproximate Symbolic Execution Research Papers | ||
17:45 15mLive Q&A | Discussion and Q&A Research Papers |
18:00 - 18:30 | |||
18:00 30mBreak | Break/Networking Research Papers |
18:30 - 19:30 | |||
18:30 60mSocial Event | Pubquiz II Research Papers |
Accepted Papers
ICST 2022 Testing Tools Call for Papers
The Testing Tools Track seeks to bridge the gap between research and practice, focusing on software testing, verification, and validation. Its main goal is to advance both the state of the art and the state of the practice. The track invites submissions that describe tools at several stages of maturity, including promising research prototypes, widely used research tools, and commercial tools (if they contribute to the scientific knowledge). This track seeks submissions from both academia and industry to foster discussions between researchers and practitioners.
The submission details:
- Testing tool paper (max 10 pages + references) and a demo video of 3-5 mins
Accepted papers will be published in ICST conference proceedings.
Tool paper submissions should clearly describe the complexity of the addressed problem, solved technical challenges, and validation that the tool actually works (e.g., from previous published research work, or new experiments, with preferably experiences from using the tool in industry). Researchers are welcome to submit papers that describe novel approaches and how these approaches support tool developers in solving challenging problems.
Note that authors of tool papers will be asked to give a demonstration of the tool, in the same way as the authors of demo papers (extended abstracts). The extra page space for tool papers compared to demo papers is there to provide more insight on the tool (e.g., about the Software Engineering challenges and lessons learned behind building such tools). Therefore, authors of tool papers are not allowed to submit a demo paper for the same tool. In the unfortunate cases in which the insight provided by a tool paper is not considered of sufficient scientific and engineering quality, the paper could be still be accepted as a (shorter) extended abstract instead (if the authors agree).
Areas of interest:
The Testing Tools Track invites submissions related, but not limited, to the following areas:
- Design and development of novel tools for software testing, verification, and validation;
- Working prototypes for novel research approaches, reporting on the technical challenges and early feedback obtained from practitioners;
- Strategies and challenges for tool adoption as well as lessons learned from technology transfer of academic approaches into open source or commercial tools;
- Case studies and/or experiments involving tools in particular contexts, reporting on lessons learned and negative results (if any).
Evaluation:
Each submission will be evaluated based on:
- The relevance and significance of the addressed problem.
- The innovation element of the approach.
- The availability, maturity, and adoption of the tool.
- The presence of lessons learned from developing or using the tool.
- The quality of the presentation.
Accepted papers will appear in the ICST conference proceedings and the IEEE digital library.
Submission:
Submissions will be handled via EasyChair (ICST2022 / Testing Tools Track).
The Testing Tools Track of ICST 2022 uses single-blind reviewing, which means that authors and tools do not have to be anonymized. All submitted papers must conform to the two column IEEE conference publication format. Templates for Latex and Word are available at: http://www.ieee.org/conferences_events/conferences/publishing/templates.html;
- It must conform to the IEEE Conference Proceedings Formatting Guidelines (please use the letter format template and conference option).
- Testing tool papers must be submitted as PDF.
- The tool papers must not exceed 10 pages, including all text, figures, tables, and appendices; two additional pages containing only references are permitted.
- The submissions must have a demo video with length of 3 - 5 minutes, and the submission must have a link to an online location that allows reviewers to watch it.
The submission must also comply with the ACM plagiarism policy and procedures. In particular, the same content must not have been published elsewhere and must not be under review elsewhere while under review for ICST. The submission must also comply with the IEEE Policy on Authorship.