%0 Conference Proceedings
%T Automatic Fairness Testing of Machine Learning Models
%+ University of Paderborn
%A Sharma, Arnab
%A Wehrheim, Heike
%Z Part 4: Testing Methods and Automation
%< avec comité de lecture
%( Lecture Notes in Computer Science
%B 32th IFIP International Conference on Testing Software and Systems (ICTSS)
%C Naples, Italy
%Y Valentina Casola
%Y Alessandra De Benedictis
%Y Massimiliano Rak
%I Springer International Publishing
%3 Testing Software and Systems
%V LNCS-12543
%P 255-271
%8 2020-12-09
%D 2020
%R 10.1007/978-3-030-64881-7_16
%K Fairness
%K Machine learning testing
%K SMT solving
%Z Computer Science [cs]
%Z Computer Science [cs]/Networking and Internet Architecture [cs.NI]Conference papers
%X In recent years, there has been an increased application of machine learning (ML) to decision making systems. This has prompted an urgent need for validating requirements on ML models. Fairness is one such requirement to be ensured in numerous application domains. It specifies a software as “learned” by an ML algorithm to not be biased in the sense of discriminating against some attributes (like gender or age), giving different decisions upon flipping the values of these attributes.In this work, we apply verification-based testing (VBT) to the fairness checking of ML models. Verification-based testing employs verification technology to generate test cases potentially violating the property under interest. For fairness testing, we additionally provide a specification language for the formalization of different fairness requirements. From the ML model under test and fairness specification VBT automatically generates test inputs specific to the specified fairness requirement. The empirical evaluation on several benchmark ML models shows verification-based testing to perform better than existing fairness testing techniques with respect to effectiveness.
%G English
%Z TC 6
%Z WG 6.1
%2 https://inria.hal.science/hal-03239825/document
%2 https://inria.hal.science/hal-03239825/file/497758_1_En_16_Chapter.pdf
%L hal-03239825
%U https://inria.hal.science/hal-03239825
%~ IFIP-LNCS
%~ IFIP
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC6
%~ IFIP-WG6-1
%~ IFIP-ICTSS
%~ IFIP-LNCS-12543