Write a Blog >>
ICST 2022
Mon 4 - Fri 8 April 2022

ICST 2022 invites high quality submissions in all areas of software testing, verification, and validation. Papers for the research track should present novel and original work that advances the state-of-the-art. Case studies and empirical research papers are also welcome.

Supporters
Silver Sponsor
Silver Sponsor
Silver Sponsor
Bronze Sponsor
Dates
Tracks
You're viewing the program in a time zone which is different from your device's time zone - change time zone

Tue 5 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:45 - 10:15
09:45
30m
Day opening
Opening
Research Papers

11:00 - 11:30
11:00
30m
Break
Break/Networking
Research Papers

11:30 - 12:45
ICST Automated Testing ITesting Tools / Research Papers at Margaret Hamilton
Chair(s): Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit
11:30
15m
Talk
Applying Symbolic Execution to Test Implementations of a Network Protocol Against its Specification
Research Papers
Hooman Asadian Uppsala University, Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden
Pre-print
11:45
15m
Talk
Model-based Testing of Scratch Programs
Testing Tools
Katharina Götz University of Passau, Patric Feldmeier University of Passau, Gordon Fraser University of Passau
12:00
15m
Talk
CITRUS: Automated Unit Testing Tool for Real-world C++ Programs
Testing Tools
Robert Sebastian Herlim KAIST, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc.
12:15
15m
Talk
Symbolic Verification of Message Signatures in MPI
Research Papers
Hengbiao Yu National University of Defense Technology, Banghu Yin National University of Defense Technology, Xin Yi National University of Defense Technology
12:30
15m
Live Q&A
Discussion and Q&A
Research Papers

12:45 - 14:00
Lunch / BreakResearch Papers at Networking
12:45
75m
Break
Break/Networking
Research Papers

14:00 - 15:15
ICST Field / Production testingResearch Papers / Industry at Margaret Hamilton
Chair(s): Annibale Panichella Delft University of Technology
14:00
15m
Talk
Testing Software in Production Environments with Data from the Field
Research Papers
Luca Gazzola Università degli Studi di Milano-Bicocca, Leonardo Mariani University of Milano-Bicocca, Matteo Orru University of Milano Bicocca, Mauro Pezze USI Lugano; Schaffhausen Institute of Technology, Martin Tappler TU Graz; Silicon Austria Labs
14:15
15m
Talk
Automatic Error Classification and Root Cause Determination while Replaying Recorded Workload Data at SAP HANA
Industry
Neetha Jambigi University of Innsbruck, Thomas Bach SAP, Felix Schabernack SAP, Michael Felderer University of Innsbruck
14:30
15m
Talk
FAUSTA: Scaling Dynamic Analysis with Traffic Generation at WhatsApp
Industry
Ke Mao Meta, Timotej Kapus Facebook, Inc., Lambros Petrou Facebook, Inc., Ákos Hajdu Facebook, Matteo Marescotti Facebook, Inc., Andreas Löscher Facebook, Inc., Mark Harman Facebook, Inc., Dino Distefano Facebook London
14:45
15m
Talk
Smoke Testing of Cloud Systems
Research Papers
Cecilio Cannavacciuolo , Leonardo Mariani University of Milano-Bicocca
15:00
15m
Live Q&A
Discussion and Q&A
Research Papers

15:15 - 15:45
15:15
30m
Break
Break/Networking
Research Papers

15:45 - 16:45
ICST AI IResearch Papers / Industry at Margaret Hamilton
Chair(s): Raihana Ferdous Fondazione Bruno Kessler
15:45
15m
Talk
IFRIT: Focused Testing through Deep Reinforcement Learning
Research Papers
Andrea Romdhana DIBRIS - University of Genoa, FBK - Security & Trust unit, Mariano Ceccato University of Verona, Alessio Merlo DIBRIS - University of Genoa, Paolo Tonella USI Lugano
16:00
15m
Talk
Robustness assessment and improvement of a neural network for blood oxygen pressure estimation
Industry
Paolo Arcaini National Institute of Informatics , Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo, Daniele Gamba AISent S.r.l., Rita Pedercini AISent S.r.l.
Pre-print
16:15
15m
Talk
Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests
Research Papers
Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield
16:30
15m
Live Q&A
Discussion and Q&A
Research Papers

16:45 - 17:00
16:45
15m
Break
Break/Networking
Research Papers

17:00 - 18:00
17:00
60m
Social Event
Pubquiz I
Research Papers

18:00 - 19:30
Dinner / BreakResearch Papers at Networking
18:00
90m
Break
Break/Networking
Research Papers

19:30 - 20:45
ICST GUI Testing and FuzzingResearch Papers / Tool Demos at Margaret Hamilton
Chair(s): Andrea Stocco Università della Svizzera italiana (USI)
19:30
15m
Talk
A Framework for Automated API Fuzzing at Enterprise Scale
Research Papers
Riyadh Mahmood The Aerospace Corporation, Jay Pennington The Aerospace Corporation, Danny Tsang The Aerospace Corporation, Tan Tran The Aerospace Corporation, Andrea Bogle The Aerospace Corporation
19:45
15m
Talk
GUI Test Transfer from Web to Android
Research Papers
Jun-Wei Lin University of California, Irvine, Sam Malek University of California at Irvine, USA
20:00
15m
Talk
DTLS-Fuzzer: A DTLS Protocol State Fuzzer
Tool Demos
Paul Fiterau-Brostean Uppsala University, Bengt Jonsson Uppsala University, Sweden, Konstantinos (Kostis) Sagonas Uppsala University, Sweden, Fredrik Tåkvist Uppsala University
Pre-print Media Attached
20:15
15m
Talk
Automated Detection of TalkBack Interactive Accessibility Failures in Android Applications
Research Papers
Ali S. Alotaibi University of Southern California, Paul T. Chiou University of Southern California, William G.J. Halfond University of Southern California
20:30
15m
Live Q&A
Discussion and Q&A
Research Papers

Wed 6 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

09:45 - 11:00
ICST Regression TestingResearch Papers / Journal-First Papers / Industry at Margaret Hamilton
Chair(s): Rachel Tzoref-Brill IBM Research
09:45
15m
Talk
TESRAC: A Framework for Test Suite Reduction Assessment at Scale
Research Papers
João Becho LaSiGE & FCUL, University of Lisbon, Frederico Cerveira CISUC & DEI, University of Coimbra, João Leitão NOVA LINCS & FCT, NOVA University of Lisbon, Rui André Oliveira NOVA LINCS & FCT, NOVA University of Lisbon
10:00
15m
Talk
Less is More: Simplification of Test Scenarios for Autonomous Driving System Testing
Industry
Paolo Arcaini National Institute of Informatics , Xiaoyi Zhang National Institute of Informatics, Japan, Fuyuki Ishikawa National Institute of Informatics
10:15
15m
Talk
An effective formulation of the multi-criteria test suite minimization problem
Journal-First Papers
Okan Orsan Ozener Özyeğin University, Hasan Sozer Ozyegin University
Link to publication DOI
10:30
15m
Talk
Dynamic test prioritization of product lines: An application on configurable simulation models
Journal-First Papers
Urtzi Markiegi Mondragon Unibertsitatea, Aitor Arrieta Mondragon University, Leire Etxeberria Mondragon Unibertsitatea, Goiuria Sagardui Mondragon University
Link to publication DOI
10:45
15m
Live Q&A
Discussion and Q&A
Research Papers

11:00 - 11:30
11:00
30m
Break
Break/Networking
Research Papers

11:30 - 12:45
ICST Fuzzing and Random TestingResearch Papers / Journal-First Papers / Industry at Margaret Hamilton
Chair(s): Marcel Böhme MPI-SP, Germany and Monash University, Australia
11:30
15m
Talk
Metamorphic Fuzzing of C++ Libraries
Research Papers
Andrei Lascu Imperial College London, Alastair F. Donaldson Imperial College London, Tobias Grosser University of Edinburgh, Torsten Hoefler ETH Zurich
11:45
15m
Talk
POWER: Program Option-Aware Fuzzer for High Bug Detection Ability
Research Papers
Ahcheong Lee KAIST, Irfan Ariq KAIST, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc.
12:00
15m
Talk
Comparing Fuzzers on a Level Playing Field with FuzzBench
Industry
Dario Asprone University College London (UCL), Jonathan Metzman Google, Abhishek Arya Google, Giovani Guizzo University College London, Federica Sarro University College London
12:15
15m
Talk
SWFC-ART: A cost-effective approach for Fixed-Size-Candidate-Set Adaptive Random Testing through small world graphs
Journal-First Papers
Muhammad Ashfaq Jiangsu University, Rubing Huang Macau University of Science and Technology (MUST), Dave Towey University of Nottingham Ningbo China, Michael Omari Takoradi Technical University, Dmitry Yashunin Harman X, Patrick Kwaku Kudjo University of Professional Studies, Accra-Ghana, Tao Zhang Macau University of Science and Technology (MUST)
Link to publication DOI
12:30
15m
Live Q&A
Discussion and Q&A
Research Papers

12:45 - 14:00
Lunch / BreakResearch Papers at Networking
12:45
75m
Break
Break/Networking
Research Papers

14:45 - 15:15
14:45
30m
Social Event
Ice-Breakers and Get to know each other
Research Papers

15:15 - 16:30
ICST AI IITesting Tools / Research Papers / Industry at Margaret Hamilton
Chair(s): Donghwan Shin University of Luxembourg
15:15
15m
Talk
Learning Realistic Mutations: Bug Creation for Neural Bug Detectors
Research Papers
Cedric Richter Carl von Ossietzky Universität Oldenburg / University of Oldenburg, Heike Wehrheim Carl von Ossietzky Universität Oldenburg / University of Oldenburg
15:30
15m
Talk
SUPERNOVA: Automating Test Selection and Defect Prevention in AAA Video Games Using Risk Based Testing and Machine Learning
Industry
Alexander Senchenko Electronics Arts, Jordan Patterson Electronics Arts, Hamman Samuel Electronics Arts, Dan Ispir Electronics Arts
Pre-print
15:45
15m
Talk
RiverGame - a game testing tool using artificial intelligence
Testing Tools
Ciprian Paduraru University of Bucharest, Miruna Gabriela Paduraru University of Bucharest , Alin Stefanescu University of Bucharest
16:00
15m
Talk
Machine Learning Based Invariant Generation: A Framework and Reproducibility Study
Research Papers
Jan Haltermann University of Oldenburg, Heike Wehrheim Carl von Ossietzky Universität Oldenburg / University of Oldenburg
16:15
15m
Live Q&A
Discussion and Q&A
Research Papers

16:30 - 16:45
16:30
15m
Break
Break/Networking
Research Papers

16:45 - 18:00
ICST Empirical StudyJournal-First Papers / Research Papers at Margaret Hamilton
Chair(s): Mohammad Reza Mousavi King's College London
16:45
15m
Talk
An experimental and practical study on the equivalent mutant connection: An evolutionary approach
Journal-First Papers
Pedro Delgado-Pérez Universidad de Cádiz, Francisco Chicano University of Malaga
Link to publication DOI
17:00
15m
Talk
A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests
Research Papers
Sarra Habchi University of Luxembourg, Luxembourg, Guillaume Haben University of Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg
Pre-print
17:15
15m
Talk
As Code Testing: Characterizing Test Quality in Open Source Ansible Development
Research Papers
Mohammed Mehedi Hasan Independent University, Akond Rahman Tennessee Tech University
Pre-print File Attached
17:30
15m
Talk
A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It
Research Papers
Martin Gruber BMW Group, University of Passau, Gordon Fraser University of Passau
Pre-print
17:45
15m
Live Q&A
Discussion and Q&A
Research Papers

18:00 - 19:30
Dinner / BreakResearch Papers at Networking
18:00
90m
Break
Break/Networking
Research Papers

19:30 - 20:45
ICST Automated Testing 2Research Papers / Journal-First Papers at Margaret Hamilton
Chair(s): Jose Campos University of Lisbon, Portugal
19:30
15m
Talk
Providing Real-time Assistance for Repairing Runtime Exceptions using Stack Overflow Posts
Research Papers
Sonal Mahajan Uber Technologies Inc., Mukul Prasad Fujitsu Research of America
19:45
15m
Talk
To Seed or Not to Seed? An Empirical Analysis of Usage of Seeds for Testing in Machine Learning Projects
Research Papers
Saikat Dutta University of Illinois at Urbana-Champaign, Anshul Arunachalam University of Illinois at Urbana-Champaign, Sasa Misailovic University of Illinois at Urbana-Champaign
20:00
15m
Talk
Integration testing for robotic systems
Journal-First Papers
Maria Brito Federal University of Lavras Lavras, Simone do Rocio Senger de Souza ICMC/USP, Paulo Sergio Lopes de Souza ICMC/USP
Link to publication DOI
20:15
15m
Talk
Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance
Research Papers
Samiha Shimmi Northern Illinois University, Mona Rahimi Northern Illinois University
20:30
15m
Live Q&A
Discussion and Q&A
Research Papers

Thu 7 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

10:00 - 11:00
ICST Machine and Constraints LearningResearch Papers / Journal-First Papers at Margaret Hamilton
Chair(s): Gunel Jahangirova USI Lugano
10:00
15m
Talk
Documentation-based functional constraint generation for library methods
Journal-First Papers
Renhe Jiang Nanjing University, Zhengzhao Chen Nanjing University, Yu Pei Hong Kong Polytechnic University, Minxue Pan Nanjing University, Tian Zhang Nanjing University, Xuandong Li Nanjing University
Link to publication DOI
10:15
15m
Talk
Learning-based mutant reduction using fine-grained mutation operators
Journal-First Papers
Yunho Kim Hanyang University, Shin Hong Handong Global University
Link to publication DOI
10:30
15m
Talk
An Empirical Study of IR-based Bug Localization for Deep Learning-based Software
Research Papers
Misoo Kim Sungkyunkwan University, Youngkyoung Kim Sungkyunkwan University, Eunseok Lee Sungkyunkwan University
10:45
15m
Live Q&A
Discussion and Q&A
Research Papers

11:00 - 11:30
11:00
30m
Break
Break/Networking
Research Papers

11:30 - 12:45
ICST API Testing and Program RepairIndustry / Research Papers at Margaret Hamilton
Chair(s): Thomas Durieux KTH
11:30
15m
Talk
Harvesting Production GraphQL Queries to Detect Schema Faults
Research Papers
Louise Zetterlund Redeye AB, Deepika Tiwari KTH Royal Institute of Technology, Martin Monperrus KTH Royal Institute of Technology, Benoit Baudry KTH
11:45
15m
Talk
Automated Repair of Responsive Web Page Layouts
Research Papers
Ibrahim Althomali The University of Sheffield, Gregory Kapfhammer Allegheny College, Phil McMinn University of Sheffield
12:00
15m
Talk
Repairing Fragile GUI Test Cases Using Word and Layout Embedding
Industry
Juyeon Yoon Korea Advanced Institute of Science and Technology, Seungjun Chung KAIST, Kihyuck Shin Samsung Electronics, Jinhan Kim KAIST, Shin Hong Handong Global University, Shin Yoo KAIST
12:15
15m
Talk
Testing a PL/I Compiler using Precomputation-based Program Generation
Industry
Jesse Postema Universiteit Van Amsterdam, Johan Fabry Raincode Labs, Belgium, Yannick Barthol Raincode Labs, Ana Maria Oprescu University of Amsterdam
12:30
15m
Live Q&A
Discussion and Q&A
Research Papers

12:45 - 14:00
Lunch / BreakResearch Papers at Networking
12:45
75m
Break
Break/Networking
Research Papers

14:45 - 15:15
14:45
30m
Break
Break/Networking
Research Papers

15:15 - 16:15
ICST Test GenerationTesting Tools / Research Papers at Margaret Hamilton
Chair(s): Xavier Devroey University of Namur
15:15
15m
Talk
TACKLETEST: A Tool for Amplifying Test Generation via Type-Based Combinatorial Coverage
Testing Tools
Rachel Tzoref-Brill IBM Research, Saurabh Sinha IBM Research, Antonio Abu Nassar IBM Research, Victoria Goldin IBM Research, Haim Kermany IBM Research
15:30
15m
Talk
JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs
Research Papers
Man Zhang Kristiania University College, Norway, Asma Belhadi Kristiania University College, Andrea Arcuri Kristiania University College and Oslo Metropolitan University
15:45
15m
Paper
Assessor: a PO-Based WebDriver Test Suites Generator from Selenium IDE Recordings
Testing Tools
Maurizio Leotta DIBRIS, University of Genova, Italy, Antonio Molinari Università di Genova, Filippo Ricca Università di Genova
16:00
15m
Live Q&A
Discussion and Q&A
Research Papers

16:15 - 16:45
16:15
30m
Break
Break/Networking
Research Papers

16:45 - 18:00
ICST Symbolic executionResearch Papers / Industry / Testing Tools / Journal-First Papers at Margaret Hamilton
Chair(s): Arie van Deursen Delft University of Technology, Netherlands
16:45
15m
Talk
Translating EULYNX SysML models into Symbolic Transition Systems for Model-Based Testing of Railway signaling systems
Industry
Tobias Bachmann Universiteit van Amsterdam, Machiel van der Bijl Axini, Daan van der Meij ProRail, Djurre van der Wal University of Twente, Ana Maria Oprescu University of Amsterdam
17:00
15m
Talk
Model checking C++ programs
Journal-First Papers
Felipe R. Monteiro Amazon, Mikhail R. Gadelha Igalia, Lucas C. Cordeiro University of Manchester, UK
Link to publication DOI
17:15
15m
Talk
SIFT: A Tool for Property Directed Symbolic Execution of Multithreaded Software
Testing Tools
Tuba Yavuz University of Florida
17:30
15m
Talk
Automating Differential Testing with Overapproximate Symbolic Execution
Research Papers
Richard Rutledge Georgia Institute of Technology, Alessandro Orso Georgia Tech
17:45
15m
Live Q&A
Discussion and Q&A
Research Papers

18:00 - 18:30
Dinner / BreakResearch Papers at Networking
18:00
30m
Break
Break/Networking
Research Papers

18:30 - 19:30
18:30
60m
Social Event
Pubquiz II
Research Papers

Accepted Papers

Title
A Framework for Automated API Fuzzing at Enterprise Scale
Research Papers
An Empirical Study of IR-based Bug Localization for Deep Learning-based Software
Research Papers
Applying Symbolic Execution to Test Implementations of a Network Protocol Against its Specification
Research Papers
Pre-print
A Qualitative Study on the Sources, Impacts, and Mitigation Strategies of Flaky Tests
Research Papers
Pre-print
As Code Testing: Characterizing Test Quality in Open Source Ansible Development
Research Papers
Pre-print File Attached
A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It
Research Papers
Pre-print
Automated Detection of TalkBack Interactive Accessibility Failures in Android Applications
Research Papers
Automated Repair of Responsive Web Page Layouts
Research Papers
Automating Differential Testing with Overapproximate Symbolic Execution
Research Papers
Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests
Research Papers
GUI Test Transfer from Web to Android
Research Papers
Harvesting Production GraphQL Queries to Detect Schema Faults
Research Papers
IFRIT: Focused Testing through Deep Reinforcement Learning
Research Papers
JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs
Research Papers
Learning Realistic Mutations: Bug Creation for Neural Bug Detectors
Research Papers
Machine Learning Based Invariant Generation: A Framework and Reproducibility Study
Research Papers
Metamorphic Fuzzing of C++ Libraries
Research Papers
Patterns of Code-to-Test Co-evolution for Automated Test Suite Maintenance
Research Papers
POWER: Program Option-Aware Fuzzer for High Bug Detection Ability
Research Papers
Providing Real-time Assistance for Repairing Runtime Exceptions using Stack Overflow Posts
Research Papers
Smoke Testing of Cloud Systems
Research Papers
Symbolic Verification of Message Signatures in MPI
Research Papers
TESRAC: A Framework for Test Suite Reduction Assessment at Scale
Research Papers
Testing Software in Production Environments with Data from the Field
Research Papers
To Seed or Not to Seed? An Empirical Analysis of Usage of Seeds for Testing in Machine Learning Projects
Research Papers

Submitting to ICST2022: Q&A

Please note that the Double-Blind Review (DBR) process is not used by all tracks, e.g., Industry Track. Check in the call for papers whether DBR is used or not.

Q: How does one prepare an ICST 2022 submission for double-­blind reviewing?

In order to comply, you do not have to make your identity undiscoverable; the double­-blind aspect of the review process is not an adversarial identity discovery process. Essentially, the guiding principle should be to maximize the number of people who could plausibly be authors, subject to the constraint that no change is made to any technical details of the work. Therefore, you should ensure that the reviewers are able to read and review your paper without having to know who any of the authors are. Specifically, this involves at least the following four points:

  1. Omit all authors’ names, affiliations, emails, and related information from the title page as well as from the content of the paper itself.
  2. Refer to your own work in the third person. You should not change the names of your own tools, approaches or systems, since this would clearly compromise the review process. It breaks the constraint that “no change is made to any technical details of the work”. Instead, refer to the authorship or provenance of tools, approaches, or systems in the third person, so that it is credible that another author could have written your paper.
  3. Do not rely on supplementary material (your website, GitHub repository, YouTube channel, a companion technical report, or thesis) in the paper. Supplementary information might result in revealing author identities.
  4. Anonymize project and grant names and numbers or those of funding agencies or countries as well as any acknowledgments of support to the work you report on.

We further expect you to follow the excellent advice on anonymization from ACM.

When anonymizing your email, affiliations, name, etc., try to refrain from being overly creative or “funny” by coming up with your own, anonymized versions. For emails preferably use author1@anon.org, author2@anon.org, etc., since initial DBR screening will be done by an automated tool.

Q: I previously published an earlier version of this work in a venue that does not have double-blind. What should I do about acknowledging that previous work?

Double-blind does not and cannot mean that it is impossible for the referees to discover the identity of the author. However, we require authors to help make it easy for author identity to not play a role in the reviewing process. Therefore, we ask that in the materials you submit to us to be reviewed author identity is not revealed.

If the work you are submitting for review has previously been published in a non-peer-reviewed venue (e.g., arXiv departmental tech report), there is no need to cite it, because unrefereed work is not truly part of the scientific literature. If the previous work is published in a peer-reviewed venue, then it should be cited, but in the third person so that it is not clear whether or not this work was done by the author of the submitted paper or some other set of authors unknown. However, if citing in the third person would still risk that it is easy to identify the authors please err on the side of caution by also anonymizing the papers being extended (both when cited and in the reference list).

Q: Our submission makes use of work from a Ph.D./master’s thesis dissertation/report which has been published. Citing the dissertation might compromise anonymity. What should we do?

It is perfectly OK to publish work from a Ph.D./master’s thesis, and there is no need to cite it in the version submitted for review because prior dissertation publication does not compromise novelty. In the final (post-review, camera-ready) version of the paper, please do cite the dissertation to acknowledge its contribution, but in the refereed version of the paper that you submit, please refrain from citing the dissertation.

However, you need not worry whether or not the dissertation has appeared, since your job is only to help the committee review your work without awareness of author identity, but not to make it impossible for them to discover the identity of authors. The referees will be trying hard not to discover the authors’ identity, so they will likely not be searching the web to check whether there is a dissertation related to this work.

Q: I am submitting to the industry track. Should I double-blind my submission?

No, you should not. Since industry papers typically rely heavily on the industrial or practical context in which the work was carried out it would be too much to ask to require this context to be anonymized.

Q: I want to include a link to an online appendix in my submission. How should I do this?

Ideally, the information in the appendix should be anonymous and it should be uploaded to an anonymous service such as for example figshare or create a new Github (or other) sharing account that is not associated with your real name. These sites will give you a link that is anonymous. Later, if the paper is accepted you can turn that link into a non-anonymized link or just put the appendix on your own site and change the link in the camera-ready version of the paper. An alternative solution is to not include the link in the submission; normally papers should be possible to review based on only the material of the paper itself.

To upload material on Figshare please create an account there, then add a new item, use the keywords “Supplemental Materials” and add the other item-specific data and then select “Make file(s) confidential” and select “Generate private link”. Copy the URL generated there and then “Save changes”. Your file(s) can now be accessed anonymously at the given URL so you can put it in your ICST submission.

Q: What if we want to cite some unpublished work of our own (as motivation for example)

If the unpublished paper is an earlier version of the paper you want to submit to ICST and is currently under review, then you have to wait until your earlier version is through its review process before you can build on it with further submissions (this would be considered double-submission and violates ACM plagiarism policy and procedures). Otherwise, if the unpublished work is not an earlier version of the proposed ICST submission, then you should simply make it available on a website, for example, and cite it in the third person to preserve anonymity, as you are doing with others of your works.

Q: Can I disseminate a non-blinded version of my submitted work by discussing it with colleagues, giving talks, publishing it at ArXiV, etc.?

You can discuss and present your work that is under submission at small meetings (e.g., job talks, visits to research labs, a Dagstuhl or Shonan meeting), but you should avoid broadly advertising it in a way that reaches the reviewers even if they are not searching for it. For example, you are allowed to put your submission on your home page and present your work at small professional meetings. However, you should not discuss your work with members of the program committee, publicize your work on mailing lists or media that are widely shared and can reach the program committee, or post your work on ArXiV or a similar site just before or after submitting it to the conference.

Call for Papers

ICST 2022 (https://icst2022.vrain.upv.es/) invites high-quality submissions in all areas of software testing, verification, and validation. Papers for the research track should present novel and original work that advances the state-of-the-art. Case studies and empirical research papers are also welcome.

Topics of Interest

Topics of interest include, but are not limited to, the following:

  • Fuzz testing
  • Manual testing practices and techniques
  • Search-based software testing
  • Security testing
  • Model-based testing
  • Test automation
  • Static analysis and symbolic execution
  • Formal verification and model checking
  • Software reliability
  • Testability and design
  • Testing and development processes
  • Testing education
  • Testing in specific domains, such as mobile, web, embedded, concurrent, distributed, cloud, GUI, and real-time systems
  • Testing for learning-enabled software, including deep learning
  • Testing video games, augmented reality
  • Testing for cyber-physical systems
  • Testing/debugging tools
  • Theory of software testing
  • Empirical studies
  • Experience reports

Each submission will be reviewed by at least three members of the ICST Program Committee.

Papers that have a strong industrial/practical component and focus more on impact rather than (technical) novelty are encouraged to consider the industry track instead.

Submission Format

Full Research papers, as well as Industry papers, must conform to the two-column IEEE conference publication format, not exceed 10 pages, including all text, figures, tables, and appendices; two additional pages containing only references are permitted. It must conform to the IEEE Conference Proceedings Formatting Guidelines (please use the letter format template and conference option). The ICST 2022 research track only accepts full research papers. Short papers are not accepted to the research track.

The submission must also comply with the ACM plagiarism policy and procedures. In particular, it must not have been published elsewhere and must not be under review elsewhere while under review for ICST. The submission must also comply with the IEEE Policy on Authorship.

Lastly, the ICST 2022 Research papers track will employ a double-blind review process. Thus, no submission may reveal its authors’ identities. The authors must make every effort to honor the double-blind review process. In particular, the authors’ names must be omitted from the submission, and references to their prior work should be in the third person. Further advice, guidance, and explanation about the double-blind review process can be found in the Q&A page.

Submissions to the Research Papers Track that meet the above requirements can be made via EasyChair (https://easychair.org/conferences/?conf=icst2022).

Any submission that does not comply with the above requirements may be rejected by the PC Chairs without further review.

If a submission is accepted, at least one author of the paper is required to attend the conference and present the paper for it to be published in the ICST 2022 conference proceedings.

Replication Material

Submissions must supply all information that is needed to replicate the results, and therefore are expected to include or point to a replication package with the necessary software, data, and instructions. Reviewers may consult these packages to resolve open issues. There can be good reasons for the absence of a replication package, such as confidential code and/or data, the research being mostly qualitative, or the paper being fully self-contained. If a paper does not come with a replication package, authors should comment on its absence in the submission data; reviewers will take such comments into account.

Be sure to first consult the guidelines on double-blind submissions outlined in the Q&A page.

Please make your submission via EasyChair using the link below, select the “ICST2022 research papers” option when prompted for the track you are submitting to: https://easychair.org/conferences/?conf=icst2022