Using Robustness Testing to Handle Incomplete Verification Results When Combining Verification and Testing Techniques - Testing Software and Systems (ICTSS 2017) Access content directly
Conference Papers Year : 2017

Using Robustness Testing to Handle Incomplete Verification Results When Combining Verification and Testing Techniques

Stefan Huster
  • Function : Author
  • PersonId : 1026235
Jonas Ströbele
  • Function : Author
  • PersonId : 1026236
Jürgen Ruf
  • Function : Author
  • PersonId : 1026237
Thomas Kropf
  • Function : Author
  • PersonId : 1026238
Wolfgang Rosenstiel
  • Function : Author
  • PersonId : 1026239

Abstract

Modular verification and dynamic testing techniques are often combined to validate complex software systems. Formal verification is used to cover all input spaces and program paths. However, due to the high complexity of modern software systems, they might not achieve complete verification results. Dynamic testing techniques can easily be applied to any type of software. Current approaches use them to handle incomplete verification results by validating unverified sections. This way of combining verification and testing ignores the fact that tests can only be used to show the presence of errors, but not their absence. Undiscovered errors pose the risk to trigger further errors in vulnerable code sections. Vulnerable sections are modularly verified, but depend on the guarantees of the tested code. We include robustness testing to analyse the influence of undiscovered errors. The generated robustness tests simulate failed guarantees within the tested code. The triggered response to those simulated errors helps the developer in adding additional error handling code. This makes the system more robust against undiscovered errors and guards it against uncontrolled crashes and unexpected behaviour in case of software failures. In the second part of this paper, we introduce a reference-architecture to generate and apply robustness tests. This architecture has been applied to multiple case studies and helped to identify potential errors yet undiscovered by generated test cases.
Fichier principal
Vignette du fichier
449632_1_En_4_Chapter.pdf (441.05 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01678963 , version 1 (09-01-2018)

Licence

Attribution

Identifiers

Cite

Stefan Huster, Jonas Ströbele, Jürgen Ruf, Thomas Kropf, Wolfgang Rosenstiel. Using Robustness Testing to Handle Incomplete Verification Results When Combining Verification and Testing Techniques. 29th IFIP International Conference on Testing Software and Systems (ICTSS), Oct 2017, St. Petersburg, Russia. pp.54-70, ⟨10.1007/978-3-319-67549-7_4⟩. ⟨hal-01678963⟩
156 View
83 Download

Altmetric

Share

Gmail Facebook X LinkedIn More