%0 Conference Proceedings
%T Fully Distributed Privacy Preserving Mini-batch Gradient Descent Learning
%+ University of Szeged [Szeged]
%A Danner, Gábor
%A Jelasity, Márk
%< avec comité de lecture
%( Lecture Notes in Computer Science
%B 15th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS)
%C Grenoble, France
%Y Alysson Bessani
%Y Sara Bouchenak
%I Springer International Publishing
%3 Distributed Applications and Interoperable Systems
%V LNCS-9038
%P 30-44
%8 2015-06-02
%D 2015
%R 10.1007/978-3-319-19129-4_3
%K Fully distributed learning
%K Mini-batch stochastic gradient descent
%K P2P smartphone networks
%K Secure sum
%Z Computer Science [cs]
%Z Computer Science [cs]/Networking and Internet Architecture [cs.NI]Conference papers
%X In fully distributed machine learning, privacy and security are important issues. These issues are often dealt with using secure multiparty computation (MPC). However, in our application domain, known MPC algorithms are not scalable or not robust enough. We propose a light-weight protocol to quickly and securely compute the sum of the inputs of a subset of participants assuming a semi-honest adversary. During the computation the participants learn no individual values. We apply this protocol to efficiently calculate the sum of gradients as part of a fully distributed mini-batch stochastic gradient descent algorithm. The protocol achieves scalability and robustness by exploiting the fact that in this application domain a “quick and dirty” sum computation is acceptable. In other words, speed and robustness takes precedence over precision. We analyze the protocol theoretically as well as experimentally based on churn statistics from a real smartphone trace. We derive a sufficient condition for preventing the leakage of an individual value, and we demonstrate the feasibility of the overhead of the protocol.
%G English
%Z TC 6
%Z WG 6.1
%2 https://inria.hal.science/hal-01775029/document
%2 https://inria.hal.science/hal-01775029/file/978-3-319-19129-4_3_Chapter.pdf
%L hal-01775029
%U https://inria.hal.science/hal-01775029
%~ IFIP-LNCS
%~ IFIP
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC6
%~ IFIP-WG6-1
%~ IFIP-DAIS
%~ IFIP-DISCOTEC
%~ IFIP-LNCS-9038