ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores - Network and Parallel Computing
Conference Papers Year : 2018

ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores

Abstract

Many distributed key-value storage systems employ the simple and effective Raft protocol to ensure data consistency. They usually assume a homogeneous node hardware configuration for the underlying cluster and thus adopt even data distribution schemes. However, today’s distributed systems tend to be heterogeneous in nodes’ I/O devices due to the regular worn I/O device replacement and the emergence of expensive new storage media (e.g., non-volatile memory). In this paper, we propose a new data layout scheme called Adaptive Layout Optimization of Raft groups (ALOR), considering the hardware heterogeneity of the cluster. ALOR aims to optimize the data layout of Raft groups to achieve a better practical load balance, which leads to higher performance. ALOR consists of two components: leader migration in Raft groups and skewed data layout based on cold data migration. We conducted experiments on a practical heterogeneous cluster, and the results indicate that, on average, ALOR improves throughput by 36.89%, reduces latency and 99th percentile tail latency by 24.54% and 21.32%, respectively.
Fichier principal
Vignette du fichier
477597_1_En_2_Chapter.pdf (1.37 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02279551 , version 1 (05-09-2019)

Licence

Identifiers

Cite

Yangyang Wang, Yunpeng Chai, Xin Wang. ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores. 15th IFIP International Conference on Network and Parallel Computing (NPC), Nov 2018, Muroran, Japan. pp.13-26, ⟨10.1007/978-3-030-05677-3_2⟩. ⟨hal-02279551⟩
78 View
90 Download

Altmetric

Share

More