Dynamic Load Balancing Techniques for Distributed Complex Event Processing Systems - Distributed Applications and Interoperable Systems (DAIS 2016)
Conference Papers Year : 2016

Dynamic Load Balancing Techniques for Distributed Complex Event Processing Systems

Nikos Zacheilas
  • Function : Author
  • PersonId : 998189
Nikolas Zygouras
  • Function : Author
  • PersonId : 998190
Nikolaos Panagiotou
  • Function : Author
  • PersonId : 998191
Vana Kalogeraki
  • Function : Author
  • PersonId : 998192
Dimitrios Gunopulos
  • Function : Author
  • PersonId : 998193

Abstract

Applying real-time, cost-effective Complex Event processing (CEP) in the cloud has been an important goal in recent years. Distributed Stream Processing Systems (DSPS) have been widely adopted by major computing companies such as Facebook and Twitter for performing scalable event processing in streaming data. However, dynamically balancing the load of the DSPS’ components can be particularly challenging due to the high volume of data, the components’ state management needs, and the low latency processing requirements. Systems should be able to cope with these challenges and adapt to dynamic and unpredictable load changes in real-time. Our approach makes the following contributions: (i) we formulate the load balancing problem in distributed CEP systems as an instance of the job-shop scheduling problem, and (ii) we present a novel framework that dynamically balances the load of CEP engines in real-time and adapts to sudden changes in the volume of streaming data by exploiting two balancing policies. Our detailed experimental evaluation using data from the Twitter social network indicates the benefits of our approach in the system’s throughput.
Fichier principal
Vignette du fichier
416479_1_En_14_Chapter.pdf (546.46 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01434793 , version 1 (13-01-2017)

Licence

Identifiers

Cite

Nikos Zacheilas, Nikolas Zygouras, Nikolaos Panagiotou, Vana Kalogeraki, Dimitrios Gunopulos. Dynamic Load Balancing Techniques for Distributed Complex Event Processing Systems. 16th IFIP WG 6.1 International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2016, Heraklion, Crete, Greece. pp.174-188, ⟨10.1007/978-3-319-39577-7_14⟩. ⟨hal-01434793⟩
82 View
105 Download

Altmetric

Share

More