%0 Conference Proceedings
%T Smoothness Bias in Relevance Estimators for Feature Selection in Regression
%+ Université Catholique de Louvain = Catholic University of Louvain (UCL)
%+ Institut Supérieur Industriel de Bruxelles (ISIB)
%+ Haute Ecole de Bruxelles (HE2B)
%+ Université de Namur [Namur] (UNamur)
%A Degeest, Alexandra
%A Verleysen, Michel
%A Frenay, Benoît
%Z Part 5: Machine Learning - Regression - Classification
%< avec comité de lecture
%( IFIP Advances in Information and Communication Technology
%B 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI)
%C Rhodes, Greece
%Y Lazaros Iliadis
%Y Ilias Maglogiannis
%Y Vassilis Plagianakos
%I Springer International Publishing
%3 Artificial Intelligence Applications and Innovations
%V AICT-519
%P 285-294
%8 2018-05-25
%D 2018
%R 10.1007/978-3-319-92007-8_25
%K Feature selection
%K Smoothness
%K Filter methods
%K Mutual information
%K Noise variance
%Z Computer Science [cs]Conference papers
%X Selecting features from high-dimensional datasets is an important problem in machine learning. This paper shows that in the context of filter methods for feature selection, the estimator of the criterion used to select features plays an important role; in particular the estimators may suffer from a bias when comparing smooth and non-smooth features. This paper analyses the origin of such bias and investigates whether this bias influences the results of the feature selection process. Results show that non-smooth features tend to be penalised especially in small datasets.
%G English
%Z TC 12
%Z WG 12.5
%2 https://inria.hal.science/hal-01821055/document
%2 https://inria.hal.science/hal-01821055/file/467708_1_En_25_Chapter.pdf
%L hal-01821055
%U https://inria.hal.science/hal-01821055
%~ IFIP
%~ IFIP-AICT
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC12
%~ IFIP-AIAI
%~ IFIP-WG12-5
%~ IFIP-AICT-519