%0 Conference Proceedings
%T Assessing Test Adequacy for Black-Box Systems without Specifications
%+ University of Leicester
%A Walkinshaw, Neil
%< avec comité de lecture
%( Lecture Notes in Computer Science
%B 23th International Conference on Testing Software and Systems (ICTSS)
%C Paris, France
%Y Burkhart Wolff
%Y Fatiha Zaïdi
%I Springer
%3 Testing Software and Systems
%V LNCS-7019
%P 209-224
%8 2011-11-07
%D 2011
%R 10.1007/978-3-642-24580-0_15
%Z Computer Science [cs]
%Z Computer Science [cs]/Networking and Internet Architecture [cs.NI]Conference papers
%X Testing a black-box system without recourse to a specification is difficult, because there is no basis for estimating how many tests will be required, or to assess how complete a given test set is. Several researchers have noted that there is a duality between these testing problems and the problem of inductive inference (learning a model of a hidden system from a given set of examples). It is impossible to tell how many examples will be required to infer an accurate model, and there is no basis for telling how complete a given set of examples is. These issues have been addressed in the domain of inductive inference by developing statistical techniques, where the accuracy of an inferred model is subject to a tolerable degree of error. This paper explores the application of these techniques to assess test sets of black-box systems. It shows how they can be used to reason in a statistically justified manner about the number of tests required to fully exercise a system without a specification, and how to provide a valid adequacy measure for black-box test sets in an applied context.
%G English
%Z TC 6
%Z WG 6.1
%2 https://inria.hal.science/hal-01583922/document
%2 https://inria.hal.science/hal-01583922/file/978-3-642-24580-0_15_Chapter.pdf
%L hal-01583922
%U https://inria.hal.science/hal-01583922
%~ IFIP-LNCS
%~ IFIP
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC6
%~ IFIP-WG6-1
%~ IFIP-ICTSS
%~ IFIP-LNCS-7019