Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses - Machine Learning for Networking
Conference Papers Year : 2020

Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses

Nageswara Rao
  • Function : Author
  • PersonId : 1102758
Neena Imam
  • Function : Author
  • PersonId : 1102759
Zhengchun Liu
  • Function : Author
  • PersonId : 1102760
Rajkumar Kettimuthu
  • Function : Author
  • PersonId : 1102761
Ian Foster
  • Function : Author
  • PersonId : 1102762

Abstract

Scientific computations are expected to be increasingly distributed across wide-area networks, and Message Passing Interface (MPI) has been shown to scale to support their communications over long distances. Application-level measurements of MPI operations reflect the connection Round-Trip Time (RTT) and loss rate, and machine learning methods have been previously developed to estimate them under deterministic periodic losses. In this paper, we consider more complex, random losses with uniform, Poisson and Gaussian distributions. We study five disparate machine leaning methods, with linear and non-linear, and smooth and non-smooth properties, to estimate RTT and loss rate over 10 Gbps connections with 0–366 ms RTT. The diversity and complexity of these estimators combined with the randomness of losses and TCP’s non-linear response together rule out the selection of a single best among them; instead, we fuse them to retain their design diversity. Overall, the results show that accurate estimates can be generated at low loss rates but become inaccurate at loss rates 10% and higher, thereby illustrating both their strengths and limitations.
Fichier principal
Vignette du fichier
487577_1_En_11_Chapter.pdf (1.87 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03266451 , version 1 (21-06-2021)

Licence

Identifiers

Cite

Nageswara Rao, Neena Imam, Zhengchun Liu, Rajkumar Kettimuthu, Ian Foster. Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses. 2nd International Conference on Machine Learning for Networking (MLN), Dec 2019, Paris, France. pp.154-174, ⟨10.1007/978-3-030-45778-5_11⟩. ⟨hal-03266451⟩
168 View
34 Download

Altmetric

Share

More