ICST 2022 invites high-quality submissions in all areas of software testing, verification, and validation. The industry track has the same topics and requires the same rigorousness as the research track. However, the industry track papers should prioritize impact and realism over novelty. We expect that industry track publications report useful testing tools, successful stories and experiences when applying software testing theories and methodologies into practice, or promising prototypes that have the potential to impact practice in the next few years. Ideally, they should be evaluated on real-world, industrial data, and discuss non-functional aspects such as scalability and reliability, and also compare to pre-existing industrial best practices. The industry track papers will be published in the ICST 2022 proceedings and listed by IEEE databases.
Tue 5 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
09:45 - 10:15 | |||
09:45 30mDay opening | Opening Research Papers |
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST Automated Testing ITesting Tools / Research Papers at Margaret Hamilton Chair(s): Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit | ||
11:30 15mTalk | Applying Symbolic Execution to Test Implementations of a Network Protocol Against its Specification Research Papers Hooman Asadian Uppsala University, Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden Pre-print | ||
11:45 15mTalk | Model-based Testing of Scratch Programs Testing Tools Katharina Götz University of Passau, Patric Feldmeier University of Passau, Gordon Fraser University of Passau | ||
12:00 15mTalk | CITRUS: Automated Unit Testing Tool for Real-world C++ Programs Testing Tools | ||
12:15 15mTalk | Symbolic Verification of Message Signatures in MPI Research Papers Hengbiao Yu National University of Defense Technology, Banghu Yin National University of Defense Technology, Xin Yi National University of Defense Technology | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:00 - 15:15 | ICST Field / Production testingResearch Papers / Industry at Margaret Hamilton Chair(s): Annibale Panichella Delft University of Technology | ||
14:00 15mTalk | Testing Software in Production Environments with Data from the Field Research Papers Luca Gazzola Università degli Studi di Milano-Bicocca, Leonardo Mariani University of Milano-Bicocca, Matteo Orru University of Milano Bicocca, Mauro Pezze USI Lugano; Schaffhausen Institute of Technology, Martin Tappler TU Graz; Silicon Austria Labs | ||
14:15 15mTalk | Automatic Error Classification and Root Cause Determination while Replaying Recorded Workload Data at SAP HANA Industry Neetha Jambigi University of Innsbruck, Thomas Bach SAP, Felix Schabernack SAP, Michael Felderer University of Innsbruck | ||
14:30 15mTalk | FAUSTA: Scaling Dynamic Analysis with Traffic Generation at WhatsApp Industry Ke Mao Meta, Timotej Kapus Facebook, Inc., Lambros Petrou Facebook, Inc., Ákos Hajdu Facebook, Matteo Marescotti Facebook, Inc., Andreas Löscher Facebook, Inc., Mark Harman Facebook, Inc., Dino Distefano Facebook London | ||
14:45 15mTalk | Smoke Testing of Cloud Systems Research Papers | ||
15:00 15mLive Q&A | Discussion and Q&A Research Papers |
15:15 - 15:45 | |||
15:15 30mBreak | Break/Networking Research Papers |
15:45 - 16:45 | ICST AI IResearch Papers / Industry at Margaret Hamilton Chair(s): Raihana Ferdous Fondazione Bruno Kessler | ||
15:45 15mTalk | IFRIT: Focused Testing through Deep Reinforcement Learning Research Papers Andrea Romdhana DIBRIS - University of Genoa, FBK - Security & Trust unit, Mariano Ceccato University of Verona, Alessio Merlo DIBRIS - University of Genoa, Paolo Tonella USI Lugano | ||
16:00 15mTalk | Robustness assessment and improvement of a neural network for blood oxygen pressure estimation Industry Paolo Arcaini National Institute of Informatics
, Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Daniele Gamba AISent S.r.l., Rita Pedercini AISent S.r.l. Pre-print | ||
16:15 15mTalk | Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests Research Papers Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield | ||
16:30 15mLive Q&A | Discussion and Q&A Research Papers |
16:45 - 17:00 | |||
16:45 15mBreak | Break/Networking Research Papers |
17:00 - 18:00 | |||
17:00 60mSocial Event | Pubquiz I Research Papers |
18:00 - 19:30 | |||
18:00 90mBreak | Break/Networking Research Papers |
19:30 - 20:45 | ICST GUI Testing and FuzzingResearch Papers / Tool Demos at Margaret Hamilton Chair(s): Andrea Stocco Università della Svizzera italiana (USI) | ||
19:30 15mTalk | A Framework for Automated API Fuzzing at Enterprise Scale Research Papers Riyadh Mahmood The Aerospace Corporation, Jay Pennington The Aerospace Corporation, Danny Tsang The Aerospace Corporation, Tan Tran The Aerospace Corporation, Andrea Bogle The Aerospace Corporation | ||
19:45 15mTalk | GUI Test Transfer from Web to Android Research Papers | ||
20:00 15mTalk | DTLS-Fuzzer: A DTLS Protocol State Fuzzer Tool Demos Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden, Fredrik Tåkvist Uppsala University Pre-print Media Attached | ||
20:15 15mTalk | Automated Detection of TalkBack Interactive Accessibility Failures in Android Applications Research Papers Ali S. Alotaibi University of Southern California, Paul T. Chiou University of Southern California, William G.J. Halfond University of Southern California | ||
20:30 15mLive Q&A | Discussion and Q&A Research Papers |
Wed 6 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST Fuzzing and Random TestingResearch Papers / Journal-First Papers / Industry at Margaret Hamilton Chair(s): Marcel Böhme MPI-SP, Germany and Monash University, Australia | ||
11:30 15mTalk | Metamorphic Fuzzing of C++ Libraries Research Papers Andrei Lascu Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, Torsten Hoefler ETH Zurich | ||
11:45 15mTalk | POWER: Program Option-Aware Fuzzer for High Bug Detection Ability Research Papers Ahcheong Lee KAIST, Irfan Ariq KAIST, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc. | ||
12:00 15mTalk | Comparing Fuzzers on a Level Playing Field with FuzzBench Industry Dario Asprone University College London (UCL), Jonathan Metzman Google, Abhishek Arya Google, Giovani Guizzo University College London, Federica Sarro University College London | ||
12:15 15mTalk | SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs Journal-First Papers Muhammad Ashfaq Jiangsu University, Rubing Huang Macau University of Science and Technology (MUST), Dave Towey University of Nottingham Ningbo China, Michael Omari Takoradi Technical University, Dmitry Yashunin Harman X, Patrick Kwaku Kudjo University of Professional Studies, Accra-Ghana, Tao Zhang Macau University of Science and Technology (MUST) Link to publication DOI | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:45 - 15:15 | |||
14:45 30mSocial Event | Ice-Breakers and Get to know each other Research Papers |
16:30 - 16:45 | |||
16:30 15mBreak | Break/Networking Research Papers |
16:45 - 18:00 | ICST Empirical StudyJournal-First Papers / Research Papers at Margaret Hamilton Chair(s): Mohammad Reza Mousavi King's College London | ||
16:45 15mTalk | An experimental and practical study on the equivalent mutant connection: An evolutionary approach Journal-First Papers Link to publication DOI | ||
17:00 15mTalk | A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests Research Papers Sarra Habchi University of Luxembourg, Luxembourg, Guillaume Haben University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg Pre-print | ||
17:15 15mTalk | As Code Testing: Characterizing Test Quality in Open Source Ansible Development Research Papers Pre-print File Attached | ||
17:30 15mTalk | A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It Research Papers Pre-print | ||
17:45 15mLive Q&A | Discussion and Q&A Research Papers |
18:00 - 19:30 | |||
18:00 90mBreak | Break/Networking Research Papers |
19:30 - 20:45 | ICST Automated Testing 2Research Papers / Journal-First Papers at Margaret Hamilton Chair(s): José Campos University of Lisbon, Portugal | ||
19:30 15mTalk | Providing Real-time Assistance for Repairing Runtime Exceptions using Stack Overflow Posts Research Papers | ||
19:45 15mTalk | To Seed or Not to Seed? An Empirical Analysis of Usage of Seeds for Testing in Machine Learning Projects Research Papers Saikat Dutta University of Illinois at Urbana-Champaign, Anshul Arunachalam University of Illinois at Urbana-Champaign, Sasa Misailovic University of Illinois at Urbana-Champaign | ||
20:00 15mTalk | Integration testing for robotic systems Journal-First Papers Maria Brito Federal University of Lavras Lavras, Simone do Rocio Senger de Souza ICMC/USP, Paulo Sergio Lopes de Souza ICMC/USP Link to publication DOI | ||
20:15 15mTalk | Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance Research Papers | ||
20:30 15mLive Q&A | Discussion and Q&A Research Papers |
Thu 7 AprDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:00 - 11:00 | ICST Machine and Constraints LearningResearch Papers / Journal-First Papers at Margaret Hamilton Chair(s): Gunel Jahangirova USI Lugano | ||
10:00 15mTalk | Documentation-based functional constraint generation for library methods Journal-First Papers Renhe Jiang Nanjing University, Zhengzhao Chen Nanjing University, Yu Pei Hong Kong Polytechnic University, Minxue Pan Nanjing University, Tian Zhang Nanjing University, Xuandong Li Nanjing University Link to publication DOI | ||
10:15 15mTalk | Learning-based mutant reduction using fine-grained mutation operators Journal-First Papers Link to publication DOI | ||
10:30 15mTalk | An Empirical Study of IR-based Bug Localization for Deep Learning-based Software Research Papers Misoo Kim Sungkyunkwan University, Youngkyoung Kim Sungkyunkwan University, Eunseok Lee Sungkyunkwan University | ||
10:45 15mLive Q&A | Discussion and Q&A Research Papers |
11:00 - 11:30 | |||
11:00 30mBreak | Break/Networking Research Papers |
11:30 - 12:45 | ICST API Testing and Program RepairIndustry / Research Papers at Margaret Hamilton Chair(s): Thomas Durieux KTH | ||
11:30 15mTalk | Harvesting Production GraphQL Queries to Detect Schema Faults Research Papers Louise Zetterlund Redeye AB, Deepika Tiwari KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology, Benoit Baudry KTH | ||
11:45 15mTalk | Automated Repair of Responsive Web Page Layouts Research Papers Ibrahim Althomali The University of Sheffield, Gregory Kapfhammer Allegheny College, Phil McMinn University of Sheffield | ||
12:00 15mTalk | Repairing Fragile GUI Test Cases Using Word and Layout Embedding Industry Juyeon Yoon Korea Advanced Institute of Science and Technology, Seungjun Chung KAIST, Kihyuck Shin Samsung Electronics, Jinhan Kim KAIST, Shin Hong Handong Global University, Shin Yoo KAIST | ||
12:15 15mTalk | Testing a PL/I Compiler using Precomputation-based Program Generation Industry Jesse Postema Universiteit Van Amsterdam, Johan Fabry Raincode Labs, Belgium, Yannick Barthol Raincode Labs, Ana Oprescu University of Amsterdam | ||
12:30 15mLive Q&A | Discussion and Q&A Research Papers |
12:45 - 14:00 | |||
12:45 75mBreak | Break/Networking Research Papers |
14:45 - 15:15 | |||
14:45 30mBreak | Break/Networking Research Papers |
15:15 - 16:15 | ICST Test GenerationTesting Tools / Research Papers at Margaret Hamilton Chair(s): Xavier Devroey University of Namur | ||
15:15 15mTalk | TACKLETEST: A Tool for Amplifying Test Generation via Type-Based Combinatorial Coverage Testing Tools Rachel Tzoref-Brill IBM Research, Saurabh Sinha IBM Research, Antonio Abu Nassar IBM Research, Victoria Goldin IBM Research, Haim Kermany IBM Research | ||
15:30 15mTalk | JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs Research Papers Man Zhang Kristiania University, Asma Belhadi Kristiania University College, Andrea Arcuri Kristiania University College and Oslo Metropolitan University | ||
15:45 15mPaper | Assessor: a PO-Based WebDriver Test Suites Generator from Selenium IDE Recordings Testing Tools Maurizio Leotta DIBRIS, University of Genova, Italy, Antonio Molinari Università di Genova, Filippo Ricca Università di Genova | ||
16:00 15mLive Q&A | Discussion and Q&A Research Papers |
16:15 - 16:45 | |||
16:15 30mBreak | Break/Networking Research Papers |
16:45 - 18:00 | ICST Symbolic executionResearch Papers / Industry / Testing Tools / Journal-First Papers at Margaret Hamilton Chair(s): Arie van Deursen Delft University of Technology, Netherlands | ||
16:45 15mTalk | Translating EULYNX SysML models into Symbolic Transition Systems for Model-Based Testing of Railway signaling systems Industry Tobias Bachmann Universiteit van Amsterdam, Machiel van der Bijl Axini, Daan van der Meij ProRail, Djurre van der Wal University of Twente, Ana Oprescu University of Amsterdam | ||
17:00 15mTalk | Model checking C++ programs Journal-First Papers Felipe R. Monteiro Amazon, Mikhail R. Gadelha Igalia, Lucas C. Cordeiro University of Manchester, UK Link to publication DOI | ||
17:15 15mTalk | SIFT: A Tool for Property Directed Symbolic Execution of Multithreaded Software Testing Tools Tuba Yavuz University of Florida | ||
17:30 15mTalk | Automating Differential Testing with Overapproximate Symbolic Execution Research Papers | ||
17:45 15mLive Q&A | Discussion and Q&A Research Papers |
18:00 - 18:30 | |||
18:00 30mBreak | Break/Networking Research Papers |
18:30 - 19:30 | |||
18:30 60mSocial Event | Pubquiz II Research Papers |
Accepted Papers
Call for Papers
NOTE: Date has been extended 1 week for paper submission due to difficulties setting up EasyChair for the conference.
ICST 2022 invites high quality submissions in all areas of software testing, verification, and validation. The industry track has the same topics and requires the same rigorousness as the research track. However, the industry track papers should prioritize impact and realism over novelty. We expect that industry track publications report useful testing tools, successful stories and experiences when applying software testing theories and methodologies into practice, or promising prototypes that have the potential to impact practice in the next few years. Ideally they should be evaluated on real-world, industrial data, and discuss non-functional aspects such as scalability and reliability, and also compare to pre-existing industrial best practices. The industry track papers will be published in the ICST 2022 proceedings and listed by IEEE databases.
Topics of interest include, but is not limited to, the following:
- Domain specific testing, such as: Autonomous vehicles, advanced control systems, mobile or web app testing, embedded systems testing, concurrent systems, GUI testing, etc.
- Formal verification
- Model based testing
- Model checking
- Search based software testing
- Security testing
- Software reliability
- Test automation
- Testability and design
- Testing and development processes
- Testing education
- Testing / debugging frameworks and tools
- Applications of software testing theories in practice
- Empirical studies
- Experience reports
- Mobile testing
- Testing AI products
- Applying machine learning techniques to testing
Each submission will be reviewed by at least three members of the ICST Program Committee.
Format
Industry papers must conform to the two-column IEEE conference publication format. Templates for LaTeX and Microsoft Word are available from http://www.ieee.org/conferences_events/conferences/publishing/templates.html: please use the letter format template and conference option.
Papers should be submitted in the PDF format: they must not exceed ten pages, plus up to two pages of references. Submissions will be handled via EasyChair : https://easychair.org/conferences/?conf=icst2022 . Make sure when submitting to submit to your intended track as all tracks share the same link.
Papers must neither have been previously accepted for publication nor be under submission in another conference or journal.
For your paper to be published in the ICST 2022 conference proceedings, at least one of the authors of the paper must register for the conference and confirm that she/he will present the paper in person.
Important Dates (all dates are AoE)
Submission of Abstract: Mon 27 Sep 2021
Submission of Industry Papers: Mon 04 Oct 2021
Author Notification: Mon 6 Dec 2021
Camera Ready: Sat 29 Jan 2022
Double Blind
Industry track papers do not need to be double-blinded. Since industry papers typically rely heavily on the industrial/practical context in which the work was carried out it would be too much to ask to require this context to be anonymized. Please contact the industry track chairs if you have more questions.
FAQ
Q: Does the industry track accept abstracts or short papers?
A: No. The industry track has the same rigorousness as the research papers, therefore, the industry track papers need to present the motivation, methodology, design of experiments / case studies, results, discussions, and related work in a clear and comprehensive way. Abstracts or short papers don't have enough room to incorporate these required and important contents.
Q: My paper has less than 10 pages, can I submit it to the industry track?
A: Yes, as long as your paper clearly presents the motivation, methodology, design of experiments / case studies, results, discussions, and related work.