A metamorphic testing approach for event sequences

PLoS One. 2019 Feb 19;14(2):e0212476. doi: 10.1371/journal.pone.0212476. eCollection 2019.

Abstract

Test oracles are commonly used in software testing to determine the correctness of the execution results of test cases. However, the testing of many software systems faces the test oracle problem: a test oracle may not always be available, or it may be available but too expensive to apply. One such software system is a system involving abundant business processes. This paper focuses on the testing of business-process-based software systems and proposes a metamorphic testing approach for event sequences, called MTES, to alleviate the oracle problem. We utilized event sequences to represent business processes and then applied the technique of metamorphic testing to test the system without using test oracles. To apply metamorphic testing, we studied the general rules for identifying metamorphic relations for business processes and further demonstrated specific metamorphic relations for individual case studies. Three case studies were conducted to evaluate the effectiveness of our approach. The experimental results show that our approach is feasible and effective in testing the applications with rich business processes. In addition, this paper summarizes the experimental findings and proposes guidelines for selecting good metamorphic relations for business processes.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Software / standards*
  • Software / trends
  • Software Validation*

Associated data

  • figshare/10.6084/m9.figshare.5349901

Grants and funding

This work is supported by Shandong Provincial Natural Science Foundation, China (Grant number: ZR2016FM41). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.