TailX: Scheduling Heterogeneous Multiget Queries to Improve Tail Latencies in Key-Value Stores - Distributed Applications and Interoperable Systems
Conference Papers Year : 2020

TailX: Scheduling Heterogeneous Multiget Queries to Improve Tail Latencies in Key-Value Stores

Abstract

Users of interactive services such as e-commerce platforms have high expectations for the performance and responsiveness of these services. Tail latency, denoting the worst service times, contributes greatly to user dissatisfaction and should be minimized. Maintaining low tail latency for interactive services is challenging because a request is not complete until all its operations are completed. The challenge is to identify bottleneck operations and schedule them on uncoordinated backend servers with minimal overhead, when the duration of these operations are heterogeneous and unpredictable. In this paper, we focus on improving the latency of multiget operations in cloud data stores. We present TailX, a task-aware multiget scheduling algorithm that improves tail latencies under heterogeneous workloads. TailX schedules operations according to an estimation of the size of the corresponding data, and allows itself to procrastinate some operations to give way to higher priority ones. We implement TailX in Cassandra, a widely used key-value store. The result is an improved overall performance of the cloud data stores for a wide variety of heterogeneous workloads. Specifically, our experiments under heterogeneous YCSB workloads show that TailX outperforms state-of-the-art solutions and reduces tail latencies by up to 70% and median latencies by up to 75%.
Fichier principal
Vignette du fichier
Jaiman_DAIS20.pdf (358.39 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02917566 , version 1 (25-12-2020)

Identifiers

Cite

Vikas Jaiman, Sonia Ben Mokhtar, Etienne Rivière. TailX: Scheduling Heterogeneous Multiget Queries to Improve Tail Latencies in Key-Value Stores. 20th International Conference on Distributed Applications and Interoperable Systems, Jun 2020, Valletta, Malta. pp.73-92, ⟨10.1007/978-3-030-50323-9_5⟩. ⟨hal-02917566⟩
146 View
146 Download

Altmetric

Share

More