Performance Comparison of Two Search-Based Testing Strategies for ADAS System Validation - Testing Software and Systems
Conference Papers Year : 2019

Performance Comparison of Two Search-Based Testing Strategies for ADAS System Validation

Florian Klück
  • Function : Author
  • PersonId : 1067238
Martin Zimmermann
  • Function : Author
  • PersonId : 1067239
Franz Wotawa
  • Function : Author
  • PersonId : 994796
Mihai Nica
  • Function : Author
  • PersonId : 1023377

Abstract

In this paper, we compare the performance of a genetic algorithm for test parameter optimization with simulated annealing and random testing. Simulated annealing and genetic algorithm both represent search-based testing strategies. In the context of autonomous and automated driving, we apply these methods to iteratively optimize test parameters, to aim at obtaining critical scenarios that form the basis for virtual verification and validation of Advanced Driver Assistant System (ADAS). We consider a test scenario to be critical if the underlying parameter set causes a malfunction of the system equipped with the ADAS function (i.e., near-crash or crash of the vehicle). To assess the criticality of each test scenario we rely on time-to-collision (TTC), which is a well-known and often used time-based safety indicator for recognizing rear-end conflicts. For evaluating the performance of each testing strategy, we set up a simulation framework, where we automatically run simulations for each approach until a predefined minimal TTC threshold is reached or a maximal number of iterations has passed. The genetic algorithm-based approach showed the best performance by generating critical scenarios with the lowest number of required test executions, compared to random testing and simulated annealing.
Fichier principal
Vignette du fichier
482770_1_En_9_Chapter.pdf (922.16 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02526346 , version 1 (31-03-2020)

Licence

Identifiers

Cite

Florian Klück, Martin Zimmermann, Franz Wotawa, Mihai Nica. Performance Comparison of Two Search-Based Testing Strategies for ADAS System Validation. 31th IFIP International Conference on Testing Software and Systems (ICTSS), Oct 2019, Paris, France. pp.140-156, ⟨10.1007/978-3-030-31280-0_9⟩. ⟨hal-02526346⟩
86 View
232 Download

Altmetric

Share

More