%0 Conference Proceedings %T Learning User Preferences in Ubiquitous Systems: A User Study and a Reinforcement Learning Approach %+ Spatio-Temporal Activity Recognition Systems (STARS) %+ Perception, recognition and integration for observation of activity (PRIMA) %+ Laboratoire d'Informatique de Grenoble (LIG) %A Zaidenberg, Sofia %A Reignier, Patrick %A Mandran, Nadine %< avec comité de lecture %B Artificial Intelligence Applications and Innovations %C Larnaca, Cyprus %Y Harris Papadopoulos and Andreas S. Andreou and Max Bramer %I Springer %3 IFIP Advances in Information and Communication Technology %V 339 %P 336-343 %8 2010-10-06 %D 2010 %R 10.1007/978-3-642-16239-8_44 %K Ambient Intelligence %K Context-aware Computing %K Personnal Assistant %K Reinforcement Learning %K User Study %Z Computer Science [cs]/Ubiquitous ComputingConference papers %X Our study concerns a virtual assistant, proposing services to the user based on its current perceived activity and situation (ambient intelligence). Instead of asking the user to define his preferences, we acquire them automatically using a reinforcement learning approach. Experiments showed that our system succeeded the learning of user preferences. In order to validate the relevance and usability of such a system, we have first conducted a user study. 26 non-expert subjects were interviewed using a model of the final system. This paper presents the methodology of applying reinforcement learning to a real-world problem with experimental results and the conclusions of the user study. %G English %2 https://inria.hal.science/hal-00788028/document %2 https://inria.hal.science/hal-00788028/file/Zaidenberg_AIAI2010.pdf %L hal-00788028 %U https://inria.hal.science/hal-00788028 %~ UGA %~ CNRS %~ INRIA %~ UNIV-GRENOBLE1 %~ UNIV-PMF_GRENOBLE %~ INPG %~ INRIA-SOPHIA %~ INRIA-RHA %~ LIG %~ INRIASO %~ INRIA_TEST %~ LIG_SIC %~ LIG_SIC_PRIMA %~ TESTALAIN1 %~ IFIP %~ IFIP-AICT %~ IFIP-AICT-339 %~ INRIA2 %~ INRIA-RENGRE %~ LIG_SIDCH