%0 Conference Proceedings
%T Gossip Learning as a Decentralized Alternative to Federated Learning
%+ University of Szeged [Szeged]
%+ MTA SZTE Research Group on Artificial Intelligence (RGAI)
%A Hegedűs, István
%A Danner, Gábor
%A Jelasity, Márk
%< avec comité de lecture
%( Lecture Notes in Computer Science
%B 19th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS)
%C Kongens Lyngby, Denmark
%Y José Pereira
%Y Laura Ricci
%I Springer International Publishing
%3 Distributed Applications and Interoperable Systems
%V LNCS-11534
%P 74-90
%8 2019-06-17
%D 2019
%R 10.1007/978-3-030-22496-7_5
%Z Computer Science [cs]
%Z Computer Science [cs]/Networking and Internet Architecture [cs.NI]Conference papers
%X Federated learning is a distributed machine learning approach for computing models over data collected by edge devices. Most importantly, the data itself is not collected centrally, but a master-worker architecture is applied where a master node performs aggregation and the edge devices are the workers, not unlike the parameter server approach. Gossip learning also assumes that the data remains at the edge devices, but it requires no aggregation server or any central component. In this empirical study, we present a thorough comparison of the two approaches. We examine the aggregated cost of machine learning in both cases, considering also a compression technique applicable in both approaches. We apply a real churn trace as well collected over mobile phones, and we also experiment with different distributions of the training data over the devices. Surprisingly, gossip learning actually outperforms federated learning in all the scenarios where the training data are distributed uniformly over the nodes, and it performs comparably to federated learning overall.
%G English
%Z TC 6
%Z WG 6.1
%2 https://inria.hal.science/hal-02319574/document
%2 https://inria.hal.science/hal-02319574/file/485766_1_En_5_Chapter.pdf
%L hal-02319574
%U https://inria.hal.science/hal-02319574
%~ IFIP-LNCS
%~ IFIP
%~ IFIP-TC
%~ IFIP-WG
%~ IFIP-TC6
%~ IFIP-WG6-1
%~ IFIP-DAIS
%~ IFIP-DISCOTEC
%~ IFIP-LNCS-11534