Labeled Network Stack: A Co-designed Stack for Low Tail-Latency and High Concurrency in Datacenter Services - Network and Parallel Computing
Conference Papers Year : 2018

Labeled Network Stack: A Co-designed Stack for Low Tail-Latency and High Concurrency in Datacenter Services

Abstract

Many Internet, mobile Internet, and IoT services require both low tail-latency and high concurrency in datacenters. The current protocol stack design pays more attention to throughput and average performance, considering little on tail latency and priority. We address this question by proposing a hardware-software co-designed Labeled Network Stack (LNS) for future datacenters. The key innovation is a payload labeling mechanism that distinguishes data packets in a TCP link across the full network stack, including the application, the TCP/IP and the Ethernet layer. This design enables prioritized data packets processing and forwarding along the full data path, to reduce the tail latency of critical requests. We built a prototype datacenter server to evaluate the LNS design against a standard Linux kernel stack and the mTCP research, using IoT kernel benchmark MCC. Experiment results show that the LNS design can provide an order of magnitude improvement on tail latency and concurrency.
Fichier principal
Vignette du fichier
477597_1_En_12_Chapter.pdf (227.91 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02279543 , version 1 (05-09-2019)

Licence

Identifiers

Cite

Wenli Zhang, Ke Liu, Hui Song, Lan Yu, Mingyu Chen. Labeled Network Stack: A Co-designed Stack for Low Tail-Latency and High Concurrency in Datacenter Services. 15th IFIP International Conference on Network and Parallel Computing (NPC), Nov 2018, Muroran, Japan. pp.132-136, ⟨10.1007/978-3-030-05677-3_12⟩. ⟨hal-02279543⟩
51 View
97 Download

Altmetric

Share

More